创建项目目录

mkdir transformer_from_scratch cd transformer_from_scratch

创建所有必要的文件

touch attention.py positional_encoding.py transformer_block.py train_simple_lm.py requirements.txt init.py

mkdir data

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
README.md		README.md
__init__.py		__init__.py
attention.py		attention.py
positional_encoding.py		positional_encoding.py
requirements.txt		requirements.txt
train_simple_lm.py		train_simple_lm.py
transformer_block.py		transformer_block.py