ADT7420 response time around 2 mins


I am currently using the ADT7420 temperature sensor for my project. The board I used is the EVAL-ADT7420-PMDZ board from ADI. The datasheet indicates the response time of this sensor is very quick(around 5-10s) but I found it that it took 2 mins to report room temperature(~22C) when I took the sensor out from my home refrigerator(~0C). I use all the default settings (13 bits resolution and etc.)

I wonder what might be the problems to drag down the response time?

Any advice would help and thank you in advance.