Paper recorded by Signals 4 on 2026-10-29 in cs.AI. Abstract reproduced from arXiv; link to the original below.
Published 2026-10-29 on arXiv · recorded by Signals 4 on 2026-10-30
Category: cs.AI · 人工智能 · first seen 2026-10-30
The Neural Thickets hypothesis posits that pretrained language models lie in dense neighborhoods of task-specific experts in weight space, which random Gaussian perturbations can uncover. We reproduce the reported gains, but show that they do not require this geometric explanation. Perturbing a single decoder block already recovers much of the improvement, while keeping the model entirely frozen a