Bug in original AI scaling laws caused wasted compute on oversized models

Original: Here's a cool piece of LLM lore: the original scaling laws were wrong due to a bug, which probably led to a lot of wasted compute on oversized undertrained models 🫣 (and that was before we even start

Source: x.com ↗