AI models that skip neurons memorize repeated text faster

Original: Data Scarcity and Model Sparsity: Mixtures-of-Experts Overfit More to Repeated Data

Source: arxiv.org ↗