Hugging Face details 2.8 trillion token Indic pretraining pipeline

Hugging Face has released details on scaling Indic pretraining using 2.8 trillion tokens and an open data generation pipeline to improve language model performance.

Read the full story at Hugging Face Blog ↗

Timeline · 1 report

2026-10-16 01:44 · Hugging Face Blog
Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline

More stories

Black Forest Labs releases open-weight FLUX.3 Klein image model — Hugging Face Blog
Granite Switch 4.1 offers chat, decisions, and speech in one endpoint — Hugging Face Blog
Anthropic taps nonprofits METR and SecureBio to help assess risks and safety practices — CNBC Technology
Yet Goal Solution - Music Video (Hugging Face Incident) — r/huggingface
Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels. — r/LocalLLaMA
Flux 3 VS Krea 2 + Edit lora — r/StableDiffusion
The last few weeks have been the most technologically concentrated period if time I have so far witnessed. — r/singularity
"Which models fit on my GPU?" : I made a tool that answers it for any Hugging Face model, including GGUF quants and RAM offload — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →