Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolution

Paper recorded by Signals 4 on 2026-10-08 in cs.CL. Abstract reproduced from arXiv; link to the original below.

Published 2026-10-08 on arXiv · recorded by Signals 4 on 2026-10-09

Category: cs.CL · 自然语言处理 · first seen 2026-10-09

Abstract

Skills, reusable procedural guidance added at inference, can substantially improve LLM downstream performance (Li et al., 2026). Prior work retrieves skills from a bank by semantic relevance, then uses them as inference-time patches or for model distillation. The individual utility of each skill, however, is largely neglected. We first show that, in on-policy distillation where skill-conditioned p

Read on arXiv →