Identifying which expert networks store facts in mixture-of-experts models

Original: Expert-Aware Causal Tracing of Factual Recall in Sparse MoE Language Models

Source: arxiv.org ↗