The algorithm that trains reasoning LLMs can't teach a robot to walk
Follow-up to an earlier write-up on the REINFORCE → PPO → GRPO lineage. That one ended with GRPO as "PPO minus the critic, plus a group-mean baseline", which raises an obvious question: if it's cheaper and good enough for DeepSeek's reasoning models, why does nobody use it for control? Two reasons,…
Read the full story at r/reinforcementlearning ↗
Timeline · 1 report
- 2026-10-14 07:31 · r/reinforcementlearning
The algorithm that trains reasoning LLMs can't teach a robot to walk