Paper recorded by Signals 4 on 2026-09-25 in cs.LG. Abstract reproduced from arXiv; link to the original below.
Published 2026-09-25 on arXiv · recorded by Signals 4 on 2026-09-28
Category: cs.LG · 机器学习 · first seen 2026-09-28
Low-rank adapters (LoRA) make it cheap to fine-tune a large language model once per task, but combining several independently trained adapters into one model remains difficult: merging the updates in weight space causes interference, retraining on all task data is expensive, and routing between separate adapters gives up the goal of a single combined model. We trace the difficulty to two choices t