Popular repositories Loading

1. PackKV PackKV Public

   Official repository for the paper "PackKV: Reducing KV Cache Memory Footprint through LLM-Aware Lossy Compression" (IPDPS 2026).

   Python 7 1

2. kvcomp kvcomp Public

   Python 1

3. InfiniGen_ InfiniGen_ Public

   Forked from snu-comparch/InfiniGen

   InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)

   Python

4. lmms_eval_embdc lmms_eval_embdc Public

   Python

5. transformers_embdc transformers_embdc Public

   Python

6. lm-evaluation-harness_llm2 lm-evaluation-harness_llm2 Public

   Forked from EleutherAI/lm-evaluation-harness

   A framework for few-shot evaluation of language models.

   Python