How does the ADV7441A determine which sample is which component in double data rate video modes?

In double data rate mode the ADV7441A will start after the rising edge of the DE signal with Cr - Y - Cb - Y.