xAI serves Grok on 100K GPUs using SGLang stack in 23 minutes

Original: Ex-Berkeley PhD who leads SGLang at xAI explained how they serve Grok on 100K GPUs in 23 minutes - better than $2000 inference-at-scale courses.

Source: x.com ↗