GPT2 Implementation

This is the implementation of GPT2 paper in PyTorch. This is just the architecture. It has 162262609 (162M) parameters (not training on my GPU so doesn't matter:) ).