DEV_CLRn is not going to help you avoid bus contention. DEV_OE could - although you suggest that's no good.
However, use of these, optional, functions is determined by the configuration bitstream. So, DEV_CLRn & DEV_OE will not function so until the FPGA is configuring. They may take effect early in the configuration bitstream (although I do not believe that's the case). However, until they take effect the FPGA will simply tri-state and pull-up all it's pins. So, you always have to manage the period between power up and the point at which the FPGA is configured as part of the board design.
The weak pull-ups present on the FPGA's I/O pins prior to configuration shouldn't cause any problems with bus contention. They have been known to cause problems with latch-up of other devices, easily overcome with the use of a pull-down resistor.
Once you're FPGA is configured you should be able to avoid any bus contention by design. If you only require some pins to tri-state you can code for that.
Regards,
Alex