Paper recorded by Signals 4 on 2026-10-15 in cs.AI. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-15 on arXiv · recorded by Signals 4 on 2026-10-16
Category: cs.AI · 人工智能 · first seen 2026-10-16
Mixture-of-experts (MoE) models have become an important approach for scaling model parameters. Modern MoE architectures increasingly combine two design choices: fine-grained expert segmentation and shared experts. The former increases expressiveness by enabling more expert combinations at a fixed activation ratio, and the latter introduces experts that are active for every token. We identify an e