Paper recorded by Signals 4 on 2026-10-29 in cs.CL. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-29 on arXiv · recorded by Signals 4 on 2026-10-30
Category: cs.CL · 自然语言处理 · first seen 2026-10-30
Sparse mixture-of-experts (MoE) models expand parameter capacity by activating a small subset of experts per token. Expert selection directly affects model capabilities under a fixed active-expert budget. Dense evaluation of all experts reveals weak agreement between single-router rankings and expert-utility evaluation rankings, especially in middle and deep layers. Richer signals for selection an