Rewriting Scaling Laws for Synthetic Data with Compute and Data Constraints
arXiv:2610.31867v1 Announce Type: new Abstract: Synthetic rewrites, where a language model rewrites a natural document e.g. into a target style, are now a standard ingredient of pretraining corpora. However, critical aspects of their use remain poorly understood, such as how much compute should be…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-26 04:00 · arXiv cs.LG
Rewriting Scaling Laws for Synthetic Data with Compute and Data Constraints