Skip to content

Weight Normalization#414

Open
richardassar wants to merge 2 commits intoElement-Research:masterfrom
richardassar:weight_normalization
Open

Weight Normalization#414
richardassar wants to merge 2 commits intoElement-Research:masterfrom
richardassar:weight_normalization

Conversation

@richardassar
Copy link

Added weight-normalized versions of SeqGRU, SeqLSTM and SeqLSTMP.

These modules provide stability and better generalisation, vanilla GRU/LSTM blow up close to convergence for tasks such as SampleRNN.

@BinaryBlue
Copy link

BinaryBlue commented May 16, 2017 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants