Pinned Loading

1. KDFlow KDFlow Public

   A user-friendly & efficient knowledge distillation framework for LLMs, supporting off-policy, on-policy (OPD), cross-tokenizer, multimodal, and on-policy self-distillation.

   Python 74 6

2. DSKD DSKD Public

   Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same-tokenizer and cross-tokenizer LLM distillation.

   Python 62 12

3. DSKDv2 DSKDv2 Public

   The official implementation of the paper "A Dual-Space Framework for General Knowledge Distillation of Large Language Models".

   Python 13

4. NMT-KD NMT-KD Public

   Repo for ACL2023 paper "Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation".

   Python 5 2

5. AlignDistil AlignDistil Public

   Code for ACL 2025 Paper "AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation"

   Python 3

6. CBMI CBMI Public

   The code of ACL2022 paper "Conditional Bilingual Mutual Information based Adaptive Training for Neural Machine Translation"..

   Python 14 1