Enhancements to GMM #3
Description
Experiment with:
- EM pre-training
- Separation of network for less interdependent coefficients
- Bottlenecking
- Hyperparameter optimization
- Converting the DNN layer to a bayesian DNN
See Bishop section 5.7 and Variani and the GMM notebook for more information on these potential improvements. Note that that strategies listed in Variani are for a classification problem, while the spider GMM implements regression.