--const-cache-bytes is only for __constant arguments of a kernel. Since cache misses have a large performance penalty you want to size the constant cache to be at least as large as the data set you want it to hold. In this case I would set it to be 64kB so that it can hold those two 20kB buffers using --const-cache-bytes 65536.
The only limit on the size is hardware resources. Constant caches are built of on-chip RAM inside the FPGA so if you request too large of a cache the hardware will not compile because the FPGA will run out of memory resources.
What type of data is this that you want to store in constant memory? There might be better alternatives depending on what you are doing.