Minimal-Norm Univariate Two-Layer ReLU Classification: Exact Solutions and Global Optimality with Skip Connections

Paper recorded by Signals 4 on 2026-09-23 in cs.LG. Abstract reproduced from arXiv; link to the original below.

Published 2026-09-23 on arXiv · recorded by Signals 4 on 2026-09-24

Category: cs.LG · 机器学习 · first seen 2026-09-24

Abstract

We study minimal-norm interpolation and $\ell_2$-regularized logistic-loss minimization for binary classification by univariate two-layer ReLU networks. We give complete geometric characterizations of the optimal classifiers in function space, resolving how the solutions depend on whether hidden-layer biases are included in the parameter norm. When biases are unpenalized, the minimal-norm interpol

Read on arXiv →