In buck-boost mode of MAX25610, the input OVP is Vin+Vled.
So for MAX25610 whose OVP is around 33V, it is indeed turned off by entering OVP protection.
If you need to operate at 24V Vin and 5 LEDs in buck-boost, you need to use LED driver like MAX25612.