PPO vs DPO vs GRPO: which RL method should you use?

The right method follows from the training signal you have: preference pairs point to DPO, a program that scores answers points to GRPO, and a learned reward model points to PPO. Nodus runs the first two as managed training runtimes, nodus/dpo and nodus/grpo-lora , each priced by a dry run and stop…