Deep Learning Implementation with Theano

About

This repository is simple implementation of some deep learning algorithms.

Layers

in layer.py

• Fully-Connected Layer
• 2-Dimensional Convolutional Layer
• 2-Dimensional Max Pooling Layer
• Batch Normalization Layer

Optimizers

in optimizers.py

• Stochastic Gradient Descent (SGD)
• Momentum Stochastic Gradient Descent (Momentum SGD)
• AdaGrad
• RMSprop
• AdaDelta
• Adam

Examples

• Multi-Layer Perceptron (mlp.py)
• Convolutional Neural Network (cnn.py)

Requirements

• NumPy
• Theano == 0.8.2
• Scikit-Learn
• tqdm
• Pandas (for visualization)
• Matplotlib (for visualization)