Acc is very low and does not converge during training

Hello, when I use single card for training, it does not converge all the time, and the parameters are the same as those in multi-card training.  I don't understand why a single card doesn't converge.  What parameters need to be adjusted if you are using a single card? 