How many ADCs/DACs do you need to interface to, and do they all need to transfer data between each other? If the devices do not all need to share data, then start out simpler, eg. design a board with a one channel ADC and one channel DAC, or perhaps dual channels. Even if the ADCs/DACs do need to communicate, consider using a high-speed backplane, or SERDES links (if the ADCs/DACs don't use them all).
Have you looked around to see what commercial boards exist?
Would the Altera HSMC boards work, or perhaps one of the Altera DSP kits? You could use that to see if the ADCs/DACs on those boards are adequate for your needs. Then there are devices from companies like Bittware:
http://www.bittware.com/products/prodfam.cfm They have Altera FPGA boards and ADC/DAC boards. I haven't used their boards, but would if I had an application that needed them.
What signal processing needs to be performed with these boards?
Cheers,
Dave