Transformers with CoT Discover Heavy-Ball Acceleration Through Training
arXiv:2610.31089v1 Announce Type: cross Abstract: Modern transformers often solve complex tasks by generating and refining intermediate reasoning steps. To develop a theoretical understanding of chain-of-thought (CoT) reasoning, a notable recent study by Huang et al. (2025) viewed transformers as a…
Read the full story at arXiv stat.ML ↗
Timeline · 1 report
- 2026-10-23 04:00 · arXiv stat.ML
Transformers with CoT Discover Heavy-Ball Acceleration Through Training