Paper recorded by Signals 4 on 2026-09-10 in cs.LG. Abstract reproduced from arXiv; link to the original below.
Published 2026-09-10 on arXiv · recorded by Signals 4 on 2026-09-11
Category: cs.LG · 机器学习 · first seen 2026-09-11
We introduce AdamX, a first-order optimizer that incorporates cosine similarity as an adaptive mechanism for controlling update magnitudes. The proposed method is scalable, model-agnostic, and straightforward to integrate into existing training pipelines. We further introduce a variance rectification scheme that promotes smoother optimization during the early stages of training. Overall, we provid