Potential inspiration for implementation?

[AlexanderMath]

Is this implementation inspired by https://arxiv.org/abs/1612.00188 ?

[nmasse]

Yes it is. I added a reference to that paper in model.py.
I haven't updated this code in years, so I'm uncertain how functional it is.

[AlexanderMath]

Do you think it would be difficult to adapt the code to permutation MNIST?

[nmasse]

It shouldn't be too difficult... I use a permuted MNIST task in https://github.com/nmasse/Context-Dependent-Gating (stimulus.py) if that's any help. However, since this is an RNN architecture, are you planning on using sequential MNIST (pixel by pixel or row by row)?