Skip to content

A decoder-only transformer implementation with lots of explanatory comments.

Notifications You must be signed in to change notification settings

chenneking/transformer-explained

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 

Repository files navigation

This repo implements the decoder-only version of the Transformer Architecture as defined in Attention Is All You Need (Vaswani et al.). Specifically, the implementation includes lots of very detailed comments that I had questions for when first learning about the Transformer.

About

A decoder-only transformer implementation with lots of explanatory comments.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages