Paper recorded by Signals 4 on 2026-10-27 in cs.CL. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-27 on arXiv · recorded by Signals 4 on 2026-10-28
Category: cs.CL · 自然语言处理 · first seen 2026-10-28
Language model performance depends strongly on the mixture of domains in the pretraining data corpus. Popular data mixing methods select these domain weights by training many small proxy models on random mixes and then fitting a regression model to predict performance from the mix. We recognize this practice as a domain attribution problem, where the regression measures each domain's contribution