Where Do Distilled Students Store Thinking?
arXiv:2611.04141v1 Announce Type: new Abstract: Small students degrade on large reasoning models' (LRMs') long solutions, so recent work shortens them by interpolating an LRM with a short-answer model at ratio $\lambda$. We ask what student weights retain when this teacher stops thinking, comparing…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-11-04 05:00 · arXiv cs.CL
Where Do Distilled Students Store Thinking?