Paper recorded by Signals 4 on 2026-08-28 in cs.AI. Abstract reproduced from arXiv; link to the original below.
Published 2026-08-28 on arXiv · recorded by Signals 4 on 2026-08-31
Category: cs.AI · 人工智能 · first seen 2026-08-31
Neural-network optimization in 2025-2026 is no longer well described as a succession of new Adam variants. The design space has expanded from coordinates to matrices and layers, from fixed training horizons to policies over time, and from mathematical update rules to state representations that must survive sharding and low-precision computation. This survey organizes recent optimizers and training