Could you post an image of the schematic?
Is there a pattern being driven on A or Y pins while the issue is happening?
Is the unit fully operational when EN is HIGH? If not, it might be damaged. Can you test other units of the ADG3304?