Online Learning Algorithms
- Solving Large Scale Linear Prediction Problems Using Stochastic Gradient Descent Algorithms, Tong Zhang, ICML, 2004.
- Stochastic Gradient Descent Tricks, Léon Bottou, Springer, 2012.
- Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms, Michael Collins, EMNLP, 2002.
- Adaptive Subgradient Methods for Online Learning and Stochastic Optimization, John Duchi et. al., JMLR, 2012.
- Notes on AdaGrad, Chris Dyer.
