Processor failed to go into debug mode when requested

I build a system including DDR2 SDRAM controller,when debug,sometimes it's Ok,but sometimes it show"Processor failed to go into debug mode when requested".