MoE eval mode

## Description of the problem

Currently the evaluation mode of MoE has not been implemented. While the training use dense MoE training, it is still unclear whether sparse forward works better than dense forward in MoE inference. 