How Inner Optimizers Shape Replica Scaling
arXiv:2610.19064v1 Announce Type: new Abstract: Training large language models (LLMs) across geographically distributed and poorly interconnected compute pools or data centers has become a topic of significant interest. This has led to increased study of local optimization methods such as DiLoco fo…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-15 04:00 · arXiv cs.LG
How Inner Optimizers Shape Replica Scaling