Mix-RL training causes LLMs to lose skills due to gradient conflicts

Original: 𝗠𝗶𝘅-𝗥𝗟 (pooling prompts from different domain into a single joint RL run), is the most common technique for multi-task RL post-training of LLMs. Train on math, code, and instruction-following pro

Source: x.com ↗