Human or Synthetic? What a Fixed Budget Buys for Post-Training
The loop: Models generate synthetic preference data to train their successors through Direct Preference Optimization. The resulting models achieve higher win rates at lower costs than those trained on human-annotated data.
















