Looped layers help small models learn grammar, but images hurt

Original: Loop Before You Leap: What Recurrent Depth Can and Cannot Buy in Data-Limited Pretraining

Source: arxiv.org ↗