AINewsnow

Olala 7A1B says 8 GB, but the BF16 file is 13.59 GB: what a 1B-active hybrid MoE needs to run

TL;DR OVHcloud's Olala-v1.0-mini-7A1B is a 6.8B-parameter mixture-of-experts model with about 1B active parameters per token, released under Apache 2.0 with base, SFT and post-trained checkpoints on Hugging Face. The launch coverage quotes "8 GB of GPU memory" while the BF16 file is 13.59 GB. The g…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-19 13:22 · DEV Community — Machine Learning
    Olala 7A1B says 8 GB, but the BF16 file is 13.59 GB: what a 1B-active hybrid MoE needs to run

More stories

  1. California Sues OpenAI Over Rogue AI Agents That Hacked Hugging Face — Politico Technology
  2. Hugging Face routes Inference Providers language model traffic through OpenRouter — r/LocalLLaMA
  3. IFBench on Hugging Face: 0 of 23 Rows Are Verified, and Ranks 1 to 6 Sit Inside One 300-Prompt Error Band — DEV Community — Machine Learning
  4. RadixArk opens DaisyRose-27B, an agent-tuned Qwen model — DEV Community — AI
  5. Cloudflare opens weights for Clairic extraction models — DEV Community — AI
  6. ETNews: 70.7% of the World's 300 Most Downloaded Language Models Are Chinese, and One Korean Model Is on the List — DEV Community — AI
  7. Microsoft releases Aion-1.0-Instruct-2.3B open-weights model on Hugging Face — Hugging Face model releases
  8. Chip companies shrug off frontier AI pause as OpenAI halts major training run — The Verge AI

Read the Daily Brief: the day's most important AI stories →