AINewsnow

I trained a 21B MoE (3.36B active) from scratch on 70B tokens (emergent ability observations)

Coverage of "I trained a 21B MoE (3.36B active) from scratch on 70B tokens (emergent ability observations)" from 2 sources, with a live timeline of who reported what and when.

Read the full story at r/huggingface ↗

Timeline · 2 reports

  1. 2026-10-28 13:43 · r/huggingface
    I trained a 21B MoE (3.36B active) from scratch on 70B tokens (emergent ability observations)
  2. 2026-10-28 13:43 · r/LocalLLaMA
    I trained a 21B MoE (3.36B active) from scratch on 70B tokens (emergent ability observations)

More stories

  1. DOJ Inquires About Nvidia’s Hugging Face Deal, Reuters Says — Bloomberg AI
  2. NVIDIA Nemotron 3.5 Transcribe and Granary v2: Intelligent Multilingual Transcription You Can Prompt and Adapt — Hugging Face Blog
  3. Have 8 GB of VRAM and 32 GB of RAM? You can run Qwen 3.8 Flash Next at up to 900 t/s PP and 30 t/s TG! — r/LocalLLaMA
  4. AI Is the New Insider Threat, but Plans to Address the Risk Are Coming One Layer Too Late — Unite.AI
  5. Someone built a 32-bit RISC-V CPU directly inside Qwen's model weights so it can execute instructions internaly! — r/LocalLLaMA
  6. Diffuspace/Clover-35B-A3B-Preview · Hugging Face — r/LocalLLaMA
  7. Just a little teaser - Krea 2 Turbo Distill 3step LoRA — r/StableDiffusion
  8. New 6-step adapters for Qwen-Image-2.1, no upsampling step, ~5x faster — r/huggingface

Get the daily brief of stories like this at 6:30 every morning →