warmup_epoch设置问题？

[Bo396543018]

您好，想请教下代码里warmup_epoch是如何设置的，在论文里没有看到对应的细节~

[imanfs]

I believe it's set to a default of 4 epochs here:

STCH/STCH_MTL/LibMTL/config.py

Line 67 in e788ce5

_parser.add_argument('--STCH_warmup_epoch', type=int, default=4, help=' ')

though I'm not sure what the logic behind it is--hope that helps :)

[Bo396543018]

@imanfs Thank you for your answer, I need to use this method in my own dataset, so I want to understand the logic of this parameter setting.

[Xi-L]

Sorry for the very late reply.

We observed that the losses for different tasks could be unstable (e.g., very large) at the beginning of training. Therefore, we implemented a warmup stage, and then normalized the losses relative to their loss values at the end of the [STCH_warmup_epoch] epochs. The default setting (e.g., 4 epochs) is an ad-hoc choice that may need further adjustment for different applications.