← back
arXivJames Town, Etienne Boursier, Ben Lewis, Matthias Englert, Ranko LazicTue, May 26, 2026, 7:39 AM PDT
score 16.4

How neural networks learn one neuron at a time

Original: Mildly Overparameterized ReLU Networks on Orthogonal Data: Incremental Learning and Implicit Bias

Source: arxiv.org

Writing ELI5 summary…