Why do we have models under 15b so rarely anymore?

Basically title. All labs seem to have agreed 24-27b is the minimum size they will go, nothing below that. I wonder when will we get the next sub 14b model from a SOTA lab

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

2026-10-16 13:28 · r/LocalLLaMA
Why do we have models under 15b so rarely anymore?

More stories

Meta releases Muse Spark Open, an 816B-parameter open-weight AI model — AWS Machine Learning Blog
NVIDIA RTX Spark Laptops Launch Globally with AI Agent Support — NVIDIA Blog
Reflection AI releases open-weight 501B model Beam for agentic coding — AWS Machine Learning Blog
CoreWeave CISO Warns AI Loop Challenges Security Assumptions — CoreWeave Blog
Google Research details building blocks for autonomous wet labs — Google Research Blog
Epic Games releases new launcher built with AI assistance — Ars Technica AI
Google Gemini 4 Argon Demonstrates Advanced Physical Reasoning and Robotics — Google DeepMind YouTube
Zephon brings elastically deterministic data loading to TorchTitan — PyTorch Blog

Get the daily brief of stories like this at 6:30 every morning →