Skip to content

tokenizer: add comments explaining two-shape token allocation optimiz…

3a82f80
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

Faster tokenizer #11392

tokenizer: add comments explaining two-shape token allocation optimiz…
3a82f80
Select commit
Loading
Failed to load commit list.

Annotations

1 warning
Run mypy_primer on PR (3)
succeeded Apr 18, 2026 in 11m 6s