Momentum tricks boost large-batch AI training, cutting data needs

Original: Momentum in large-batch training: Polyak enlarges the critical batch size, Nesterov improves data efficiency

Source: arxiv.org ↗