feat: v0.2.16 - SM120 GEMV/GEMM optimization and comprehensive benchmarks#121

Merged

m96-chan merged 51 commits intomainfrom

feature/v0.2.16

Dec 28, 2025

Commits on Dec 26, 2025

docs: add Codon to Acknowledgements

m96-chan
and
claude
committed
feat(moe): add MoE (Mixture of Experts) support for Mixtral

m96-chan
and
claude
committed
feat(examples): add chat_cli_moe.py for Mixtral inference

m96-chan
and
claude
committed
feat(examples): add chat_cli_thinking.py for Qwen3 Thinking models

m96-chan
and
claude
committed
feat(examples): add CUDA Graph support to chat_cli_thinking.py

m96-chan
and
claude
committed
feat(llm): add FP8 E4M3/E5M2 dtype support for quantized model loading

m96-chan
and
claude
committed
fix(loader): use _native attribute for direct mmap transfer

m96-chan
and
claude
committed
feat(examples): add CUDA Graph support to chat_cli_moe.py

m96-chan
and
claude
committed
feat(fp8): add FP8 GEMV kernel with online dequantization

m96-chan
and
claude
committed
refactor(llm): FP8 model loading without dequantization

m96-chan
and
claude
committed
feat(fp8): support LinearFP8 in MoE and Attention layers

m96-chan
and
claude
committed
refactor(layers): rename Linear to LinearBF16 for consistency

m96-chan
and
claude
committed
feat(claude): add skills and subagents for development workflow

m96-chan
and
claude
committed
docs: add CONTRIBUTING.md with contribution guidelines

m96-chan
and
claude
committed
docs: update README.md and CLAUDE.md with Claude Code config

m96-chan
and
claude
committed
docs: document matmul kernel directory structure

m96-chan
and
claude
committed
docs: update default GPU to RTX 5090

m96-chan
and
claude
committed
feat(mcp): add MCP server configuration

m96-chan
and
claude
committed
feat(mcp): add Serena for semantic code analysis

m96-chan
and
claude
committed

Commits on Dec 27, 2025