FlashInfer explains fast attention: pick pattern, generate optimized GPU kernel

Original: CMU PhD who built the kernels NVIDIA now ships in TensorRT-LLM explained fast attention in 68 minutes - better than $1200 GPU programming courses.

Source: x.com ↗