OVH announces Olala mini 7A1B
Olala mini is based on a 7-billion-parameter architecture (7B), with one billion active parameters spread across 256 experts per layer, and hybrid attention combining Differential-TPA and Mamba-3, in BF16 format. Only a fraction of the model is used for each request, making it faster and less memor…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-11-17 10:14 · r/LocalLLaMA
OVH announces Olala mini 7A1B