Signals 4 · free daily AI digest

Every Token Needs Its Own Teacher: Multi-teacher Adaptive On-policy Self-distillation

Paper recorded by Signals 4 on 2026-10-29 in cs.CL. Abstract reproduced from arXiv; link to the original below.

Published 2026-10-29 on arXiv · recorded by Signals 4 on 2026-10-30

Category: cs.CL · 自然语言处理 · first seen 2026-10-30

Abstract

On-policy Self-distillation (OPSD) has proven effective for post-training large language models by constructing a teacher conditioned on privileged references. However, existing approaches keep the teacher fixed either throughout training by consistently exposing it to the full reference, or within each response by adaptively varying partial reference exposure only across responses. In this paper,

Read on arXiv →

#63 most recent of 628 cs.CL papers we have recorded · ↑ newer: PIVOT: Progressive Intervention via Online Teacher Correction · ↓ older: IndicIPR-QA: A Benchmark for Extractive Question Answering on Indian I
Cite this page: Every Token Needs Its Own Teacher: Multi-teacher Adaptive On-policy Self-distillation: the #63 most recent of 628 cs.CL papers we have recorded (as of 2026-10-29). Source: Signals 4 (Signals API) — https://data.jiangzhang.ca/signals4/t/papers/every-token-needs-its-own-teacher-multi-teacher-adaptive-on-policy-self-distilla.html
Free to quote with attribution to “Signals 4 (Signals API)”. Machine-readable: papers.json
Related: More cs.CL papers · arXiv signals · All papers · Today in AI
Get 4 AI signals a day by email — free.
Subscribe free → See all plans →
Get 4 AI signals a day by email — free
All models · All repos · By company · Daily editions