VIP VGA signal to RGB Converter

From the VIP user guide:

--- Quote Start ---

The Clocked Video Input MegaCore function converts from clocked video formats (such as BT656, BT1120, and DVI) to Avalon-ST Video.

--- Quote End ---

The VIP suite should work fine for what you are trying to do.

Although, at least according to Google, there is no such part as the ADV7180C. Perhaps you meant ADV7181C?

If you want your final data to be RGB, I would look for a video decoder which can output RGB instead of converting to YCrCb and then having the FPGA convert it back to RGB. Looking at the data sheet quickly, it looks like the ADV7181C can output 24 bit RGB using a 12 bit DDR interface. While the Clocked Video Input cannot take DDR directly, you can use the ALT_DDIOIN function to convert to SDR first.