Ultra-FineWeb paper shows how to filter and improve training data quality

Original: The Ultra-FineWeb paper is a pretty exceptional manual for thinking about tiers of data, how to do quality filtering, and rephrasing.

Source: x.com ↗