New tool pinpoints root causes of AI model slowdowns

Original: TELLER: Non-intrusive Cross-Layer Root-Cause Analysis for LLM Inference

Source: arxiv.org ↗