I want to generate a signal with bandwidth 2.5GHz ( 3.4G ~ 5.9G ). What parameters should I set AD9164, such as sampling rate, line rate, interpolation rate?
No, it is not. The maximum amount of data you can pass over the 8 lanes of 12.5 GBPS SERDES is 5 GSPS, or 2.5 GSPS complex. Using a 2x interpolator and 90% filter bandwidth, you could achieve 2.25 GHz of bandwidth, but you would be limited to a 5 GSPS DAC clock input and 10 GSPS update rate using FIR85 enabled. To get to your center frequency, you would need to use the 3x interpolator and 90%, which would give you up to 6 GSPS input DAC clock and 12 GSPS update rate with FIR85 enabled, and a maximum of 2 GSPS complex data input, giving 1.8 GHz of signal bandwidth with the 90% filter bandwidth. In that mode, you would be able to use the NCO to shift the 1.8 GHz of signal to center frequencies up to the 6 GHz - 0.9 GHz = 5.1 GHz center frequency.
You might also look at our AD9172 (www.analog.com/ad9172), which would give you 2.4 GHz of signal bandwidth that can be shifted to the center frequency you want. The AD9172 has 15 GSPS SERDES lanes, which gives you 6 GSPS of total data bandwidth (3 GSPS complex). You could use its interpolators (all 80% filter bandwidths) to achieve a signal of 2.4 GHz bandwidth, and then shift it with the on-chip NCOs.
Retrieving data ...