"So you recommend using a reconfig controller for XCVR because the refclk frequency could change. Do you have any recommendation of how I could detect the refclk frequency change? I will not get this info (i.e. no separate signals available) from the transmitting side."
Yes you are right. You would need the reconfig controller to perform Channel and CDR reconfiguration. One thing that you should take note is that, in V generation devices, even though you are not using any reconfiguration feature, it is still mandatory to connect the reconfig controller to the PHY IP. This is for the offset cancellation to run properly.