For calculations regarding voltage, current, and capacity of the MAX17055, please use the register resolutions in the table on page 16 of the datasheet. For example, for a 5000mAh battery:
If we use a 10mohm sense resistor, the register value for capacity is 5000 mAh / (5uVh/ 10mOhm) = 10000 in decimals. In hexadecimal, it is 0x2710, that is, 0x2710 should be written into the DesignCap Register (18h).