We have set OP_FORMAT_SEL (IO map, 0x03) to 0x80 (16-bit ITU-656 SDR mode), and we have YCbCr 4:2:2 with embedded syncs on the output. The Y component is between 16 and 240, but we would like to have better color depth. Is it possible to get YCbCr 4:2:2 "almost full range" (1-254) on the output with embedded syncs? We have tested it with RGB 4:4:4 "almost full range" (1-254) by setting register 0x02 in the IO map to 0xf7 and that works fine.
For AD7441A there are some recommended settings for clamp, gain and offset in chapter 1.3.8/9/10 in "ADV7441A/AD9388A Register Settings Recommendations, Rev J, June 2009" that have to be implemented in the driver to get the right colors. Are there similar settings for ADV7604? I see that you write that manual gain control is the recommended mode in "ADV7604, Hardware Manual, Rev. F, August 2010" chapter 10.3.1, but do you have a guide telling what it should be set to for the various formats?