Weaker AI teachers can improve stronger student models

Original: This is something I wanted to study long since I ever read the original knowledge distillation paper in 2015.

Source: x.com ↗