[Feature][KVCache] Implement Cache Manager V1 with multi-GPU support and MTP KV Cache#2

Closed

kevincheng2 wants to merge 11 commits intodevelopfrom

feature/cache_manager_v1_rebase

Commits on Mar 30, 2026

[Feature][KVCache] Support cache manager v1 architecture

kevincheng2
and
claude
committed
Update cache manager and related modules

kevincheng2
and
claude
committed
chore: update cache_manager and related modules

kevincheng2
and
claude
committed
fix: add node to evictable set in complete_swap_to_device

kevincheng2
and
claude
committed
feat: update cache manager v1 and related modules

kevincheng2
and
claude
committed
feat(cache): add cache controller v1 implementation
kevincheng2
committed
feat(cache_manager): update cache manager v1
kevincheng2
committed
fix(cache_manager): 修复 swap_cache H2D/D2H 方向的 block_ids 逻辑并清理 ForwardMeta

kevincheng2
and
claude
committed
feat(cache_manager): refactor cache manager v1 and optimize swap ops
kevincheng2
committed
[KVCache][MTP] 支持 cache_manager_v1 下的 MTP KV Cache 初始化及多模态 hash
kevincheng2
committed

Commits on Mar 31, 2026

fix(cache_manager): multi-GPU fix, mm hash boundary fix, and remove batch ops

kevincheng2
and
claude
committed