src/pygpukit/llm/
└── layers.py (1491 lines - all layers)
src/pygpukit/llm/layers/
├── __init__.py (exports)
├── base.py (BaseLayer)
├── attention.py (Attention, GQA, MHA)
├── mlp.py (MLP, GatedMLP, SwiGLU)
├── norm.py (RMSNorm, LayerNorm wrappers)
├── embedding.py (TokenEmbedding, PositionEmbedding)
└── block.py (TransformerBlock)
Problem
src/pygpukit/llm/layers.pyis 1491 lines with all layer implementations.Current State
Proposed Structure
Benefits
Related