How to calculate index table values in 28.0 format

Document created by BrettG Employee on Jun 4, 2013
Version 1Show Document
  • View in full screen mode

The calculation of index values is described in application note AN-951, which is available here:

http://www.analog.com/static/imported-files/application_notes/AN-951.pdf

 

On page 11 you can find the formula for converting 28.0 index values to 5.23 values stored in RAM.

ScreenHunter_01 Aug. 19 14.50.jpg

 

Just for everybody's reference, I've listed the first 50 index points in the table below.

IndexValue (5.23 format)
00
11.19209E-07
22.38419E-07
33.57628E-07
44.76837E-07
55.96046E-07
67.15256E-07
78.34465E-07
89.53674E-07
91.07288E-06
101.19209E-06
111.31130E-06
121.43051E-06
131.54972E-06
141.66893E-06
151.78814E-06
161.90735E-06
172.02656E-06
182.14577E-06
192.26498E-06
202.38419E-06
212.50340E-06
222.62260E-06
232.74181E-06
242.86102E-06
252.98023E-06
263.09944E-06
273.21865E-06
283.33786E-06
293.45707E-06
303.57628E-06
313.69549E-06
323.81470E-06
333.93391E-06
344.05312E-06
354.17233E-06
364.29153E-06
374.41074E-06
384.52995E-06
394.64916E-06
404.76837E-06
414.88758E-06
425.00679E-06
435.12600E-06
445.24521E-06
455.36442E-06
465.48363E-06
475.60284E-06
485.72205E-06
495.84126E-06
505.96046E-06

 

This FAQ was generated from the following discussion: How to calculate an RMS table values to select filter curves?

Attachments

    Outcomes