New method slashes memory cost of AI model training by distillation

Original: Making Knowledge Distillation Cheap Enough to Run at Scale

Source: huggingface.co ↗