Algorithmic Scratchpads and Curriculum Staging for Arithmetic Reasoning in Tiny Transformers
arXiv:2610.09003v1 Announce Type: new Abstract: Autoregressive Large Language Models (LLMs) frequently struggle with deterministic multi-step algorithmic tasks such as multi-digit multiplication and long division. In this paper, we investigate the mechanics of multi-step arithmetic in compact "Tiny…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-08 04:00 · arXiv cs.LG
Algorithmic Scratchpads and Curriculum Staging for Arithmetic Reasoning in Tiny Transformers