If RL for reasoning only changes 1 to 3% of tokens, what does test-time training on a single problem change?
There's a paper going round claiming RL for reasoning only changes 1 to 3% of the tokens, and that the gains replicate without RL at a fraction of the compute. If that holds, what a small, targeted update actually moves becomes the question, and test-time training on a single problem is the sharpes…
Read the full story at r/reinforcementlearning ↗
Timeline · 1 report
- 2026-10-17 14:20 · r/reinforcementlearning
If RL for reasoning only changes 1 to 3% of tokens, what does test-time training on a single problem change?