Paper recorded by Signals 4 on 2026-10-23 in cs.CL. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-23 on arXiv · recorded by Signals 4 on 2026-10-26
Category: cs.CL · 自然语言处理 · first seen 2026-10-26
On-policy self-distillation enables post-training foundation models without relying on stronger external teachers. However, existing approaches rely on ground-truth question-answer pairs, human-curated problem sets, or other supervised signals. In this work, we reformulate on-policy self-distillation as a self-training framework, driven by self-generated question-answer pairs and privileged reason