Paper recorded by Signals 4 on 2026-10-22 in cs.AI. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-22 on arXiv · recorded by Signals 4 on 2026-10-23
Category: cs.AI · 人工智能 · first seen 2026-10-23
Online Policy Distillation (OPD) often outperforms offline methods such as Supervised Fine-Tuning (SFT) by training on trajectories sampled directly from the student. However, standard OPD trains the student to follow the teacher at every state of the trajectory, assuming that teacher guidance is always beneficial. We instead distinguish between what the teacher prefers and what actually helps the