Skip to content

fix: correct KV cache memory stats for K/V metadata and fp16 baseline #53

Open
dipeshbabu wants to merge 1 commit intoTheTom:mainfrom
dipeshbabu:fix/kv-cache-memory-stats-accounting
Open

fix: correct KV cache memory stats for K/V metadata and fp16 baseline #53
dipeshbabu wants to merge 1 commit intoTheTom:mainfrom
dipeshbabu:fix/kv-cache-memory-stats-accounting

Commits

Commits on Mar 31, 2026