DPO and RLHF aren't always equivalent, researchers find

Original: Conditional Equivalence of DPO and RLHF: Implicit Assumption, Failure Modes, and Provable Alignment

Source: arxiv.org ↗