Fix BatchRotatingKVCache.merge() OOB when prompt exceeds max_size#1052
Closed
LxYuan0420 wants to merge 3 commits intoml-explore:mainfrom
Closed
Fix BatchRotatingKVCache.merge() OOB when prompt exceeds max_size#1052LxYuan0420 wants to merge 3 commits intoml-explore:mainfrom
LxYuan0420 wants to merge 3 commits intoml-explore:mainfrom