Intuitive explanation of FlashAttention-4 for NVIDIA Blackwell

Original: such underrated content I felt I had to mention it again, idk any of the authors personally but @tedzadouri explains and motivates FA4 in an extremely intuitive way

Source: x.com ↗