DDP script and code conflict bug

[wcyjerry]

Hi, refer to PR 1675
there exists an conflict bug when using ddp.
For me, it make train process stuck at first epoch, and memory usage cost continuous increasing.
Usually, If code have set mp.start_method("spawn"), then one should not use torch.distributed.launch xxx train.py,
just python train.py is ok. So, the dist_train.sh is not suitable for code.
I have uncomment set_method, and use the dist_train.sh, the whole train process start well and no more huge memory cost.

[github-actions]

This issue is stale because it has been open for 30 days with no activity.