A descriptor is only 32 bytes, so a small on-chip memory (1k) is more than enough. If you are short on resources and want to use all the memory blocks in your main on-chip ram you can also put your descriptors there. Just connect the descriptor reader and writer master interfaces to the on-chip RAM you already have.
I think that if you set up a number of bytes to read in the descriptor, the SGDMA will ignore the start/stop signals. Then you can add those signals on your ADC stream output and put them to always 0. I agree that there should be a way to completely remove them from the SGDMA input though.