how to determine the parameter of set_max_fanout?

Are you talking about an ASIC?

Max fanout is your constraint that you would manually enter to help timing. You can enter whatever value you want. The main purpose is to help the fitter place logic closer together, and hence achieve better timing.