New course teaches efficient serving of large AI language models

Original: New course on serving LLMs efficiently -- how do you serve models to many concurrent users at low latency and reasonable cost? This short course is built with @RedHat and taught by @cedricclyburn.

Source: x.com ↗