May I know what the training error is in your case? When I plot it, the training error(RMSE) goes up while the testing error decreases. Thanks