The Emergence and Sparsification of a Syntactic Circuit
arXiv:2610.33299v1 Announce Type: new Abstract: To understand the emergence of grammatical behavior in language models, we track circuits for subject-verb number agreement in pythia-1b and ten seeds of pythia-410m across training. We find that subject-verb agreement is learned early, and is initial…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-10-27 04:00 · arXiv cs.CL
The Emergence and Sparsification of a Syntactic Circuit