on-policy self-distillation
5 notes, newest first.
H$^2$SD: Hybrid Hindsight Self-Distillation
The paper introduces H$^2$SD, a framework for reinforcement learning with verifiable rewards (RLVR) that addresses the limitations of previous methods. H$^2$SD uses a hybrid approach to self-distillation, where it…
DemoPSD: Disagreement-Modulated Policy Self-Distillation
The paper introduces DemoPSD, a novel framework for training large language models (LLMs) that addresses the issues of overfitting, suppression of exploration, cross-domain generalization problems, and privileged…
DemoPSD: Disagreement-Modulated Policy Self-Distillation
The paper introduces DemoPSD, a framework designed to address issues in on-policy self-distillation (OPSD) for training large language models. The main problems being addressed are overfitting, suppression of…
DemoPSD: Disagreement-Modulated Policy Self-Distillation
DemoPSD is a new framework for training large language models that addresses overfitting, privileged information leakage, and exploration suppression issues in on-policy self-distillation (OPSD). It does this by…
DemoPSD: Disagreement-Modulated Policy Self-Distillation
The paper introduces DemoPSD, a framework for training large language models that addresses the issues of overfitting, suppressed exploration, and privileged information leakage in on-policy self-distillation (OPSD)…
