repoGitHubTrust 82 · PrimaryPublished 19h agoLive · 18h ago
nick7nlp/Awesome-LLM-On-Policy-Distillation
A curated collection of papers and resources on On-Policy Distillation for Large Language Models.
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Implements
paperDistill to Detect: Exposing Stealth Biases in LLMs through Cartridge DistillationpaperMOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-TrainingpaperPHF: Privileged Hidden Flow for On-Policy Self-DistillationpaperPurified OPSD: On-Policy Self-Distillation Without Losing How to Think
Covers
Implements (incoming)
Related across the graph
paperMOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-TrainingnewsKnowledge Distillation of Black-Box Large Language ModelspaperDemoPSD: Disagreement-Modulated Policy Self-DistillationpaperPurified OPSD: On-Policy Self-Distillation Without Losing How to ThinkpaperPHF: Privileged Hidden Flow for On-Policy Self-DistillationpaperDistill to Detect: Exposing Stealth Biases in LLMs through Cartridge DistillationpaperNeuron-Aware Data Selection for Annotation-Free LLM Self-Distillation