Training-free early exit for reasoning models: a linear probe folded into the row of the output layer [p]
Reasoning models often reach the right answer early and then keep double-checking it for thousands of tokens. I got the model to stop at that point by changing a single row of weights. There's no training and no extra code at inference time; the edited model is an ordinary weights file that runs an…
Read the full story at r/MachineLearning ↗
Timeline · 1 report
- 2026-11-15 17:52 · r/MachineLearning
Training-free early exit for reasoning models: a linear probe folded into the row of the output layer [p]