The timing can be different for special pins, so the CLK5n pin seems like the likely explanation for mem_addr[11] having a different port rate spec. You might be able to confirm this in the device handbook.
Because you are stuck with the pin that was already wired up on the development board, there might be nothing you can do to make it run faster. If you are not using the highest available drive strength, you could try increasing the drive strength. I wouldn't bother though. Your violation was only 18 ps, so you should be OK for actual operation unless your board just happens to have a device at the slow end of the process extreme (unlikely) and you are running your board at the slow ends of the supply voltage and temperature extremes (seems unlikely for use of a development board).