Specialization, Diversity, and Scaling in Child-Scale Language Models
arXiv:2610.36679v1 Announce Type: new Abstract: Modern language models are trained on far more language than children experience, but we know much less about learning from small, naturalistic datasets. We train small GPT-2 models on transcripts of speech with children from dense home recordings (Ba…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-10-28 04:00 · arXiv cs.CL
Specialization, Diversity, and Scaling in Child-Scale Language Models