Training Time

[wumiaoshu]

Hey, I really feel like your job is amazing! I have a question. I fully used the program you provided and trained on a single 4090 graphics card for 2+4 days, totaling 1800 epochs. However, when I loaded your pre training, the epoch information displayed was 4625. Did you use methods such as training acceleration? Why did I train so few epochs in the same training time?

[FactoDeepLearning]

We used an Nvidia V100 GPU which I guess is far more efficient for deep learning training than an RTX 4090, combined with automatic mix precision (enabled by default in the training scripts)