Memory bandwidth bottleneck limits AI chip speedup gains

Original: @gokulr @saranormous @eladgil 20x speedup demands wafer-scale memory bandwidth, the off-chip transfer still dominates latency, so without integrated sram the gain caps

Source: x.com ↗