Formula to measure voltage

Hi, Gregory007. 

Thanks for your patience. The datasheet is correct in saying that the offset DAC does not affect MV and MI's voltage range but please note that it only said range. Offset DAC still affects the values of your VDUT and VMIN.

In your question, you put your VMIN at 11.249. May I know why that is? What offset DAC code are you using?

Thanks,
Mac

Hi Gregory007 ,

It seems that you're getting negative numbers because of the typo error in the given formula.

If you would take a look on page 32 of datasheet, there's a negative sign included on the VMIN calculation (see snippet below)

Best regards,

Judith

Hi jcabuhayan ,

Thanks for the answer, that's exactly my problem. By adding the "-" sign, I have the correct result.

MacManato Thank you for taking the time to answer me.