Hugging Face details 2.8 trillion token Indic pretraining pipeline

Hugging Face has released details on scaling Indic pretraining using 2.8 trillion tokens and an open data generation pipeline to improve language model performance.

Read the full story at Hugging Face Blog ↗

Timeline · 1 report

2026-10-16 01:44 · Hugging Face Blog
Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline

More stories

Black Forest Labs releases open-weight FLUX.3 Klein image model — Hugging Face Blog
Granite Switch 4.1 offers chat, decisions, and speech in one endpoint — Hugging Face Blog
BERT's tokenizer bottleneck was hiding before WordPiece — DEV Community — Machine Learning
Darwin-27B-ZTC-v5 Tops the Typed Decisions Leaderboard with a 0.81 Accuracy Score — DEV Community — Machine Learning
Anthropic taps nonprofits METR and SecureBio to help assess risks and safety practices — CNBC Technology
Yet Goal Solution - Music Video (Hugging Face Incident) — r/huggingface
Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels. — r/LocalLLaMA
Flux 3 VS Krea 2 + Edit lora — r/StableDiffusion

Get the daily brief of stories like this at 6:30 every morning →