Why AI companies offer batch APIs if slow inference has no market

Original: @gokulr @saranormous @eladgil Just pointing out a couple of things. If slow inference has no market, why is batch api available? Obviously Open AI and Anthropic see enough value there to offer it.

Source: x.com ↗