Feeding BabyLMs Macaroni: Code-Switching Curricula Cause Cross-Lingual Convergence
arXiv:2609.30535v1 Announce Type: new Abstract: Children in multilingual communities often code-switch, using multiple languages in a single utterance. Can we induce cross-lingual alignment in language models by training on code-switched text? We pretrain small decoder-only transformers on two 100M…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-09-28 04:00 · arXiv cs.CL
Feeding BabyLMs Macaroni: Code-Switching Curricula Cause Cross-Lingual Convergence