Power-aware scheduling cuts AI inference energy use by 26%

Original: PALS: Power-Aware LLM Serving for Mixture-of-Experts Models

Source: arxiv.org ↗