Muon optimizer works like a residual connection during training

Original: Muon as a Residual Connection

Source: arxiv.org ↗