Olala 7A1B says 8 GB, but the BF16 file is 13.59 GB: what a 1B-active hybrid MoE needs to run
TL;DR OVHcloud's Olala-v1.0-mini-7A1B is a 6.8B-parameter mixture-of-experts model with about 1B active parameters per token, released under Apache 2.0 with base, SFT and post-trained checkpoints on Hugging Face. The launch coverage quotes "8 GB of GPU memory" while the BF16 file is 13.59 GB. The g…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-19 13:22 · DEV Community — Machine Learning
Olala 7A1B says 8 GB, but the BF16 file is 13.59 GB: what a 1B-active hybrid MoE needs to run