AINewsnow

llama.cpp ships first stable v1.0.0 with API stability and MoE expert cache

This story is from 2026-11-14. It is preserved in the archive; the latest stories are on the live feed.

The ggml-org team released llama.cpp v1.0.0 on November 13, alongside ggml v1.0.0, bringing semantic versioning and API stability to libllama and libggml after 3.5 years. It adds an MoE expert cache keeping a configurable share of experts in host memory.

Read the full story at r/LocalLLM ↗

Timeline · 5 reports

  1. 2026-11-16 11:57 · DEV Community — AI
    Llama.cpp v1.0.0: Stable Local AI for Developers
  2. 2026-11-15 14:57 · DEV Community — Machine Learning
    llama.cpp v1.0.0: What the First Stable Release Changes for Local AI
  3. 2026-11-15 14:21 · DEV Community — AI
    llama.cpp Just Hit 1.0, and Local AI Finally Has a Promise to Stand On
  4. 2026-11-14 13:26 · DEV Community — AI
    llama.cpp Hit v1.0.0 With 150+ Architectures — and the Headline Feature Is a Promise
  5. 2026-11-14 05:00 · r/LocalLLM
    llama.cpp v1.0.0 adds a host-memory MoE expert cache with a configurable CPU share

More stories

  1. How to Speed Up Qwen3.8-27B in llama.cpp (NVIDIA's Draft Model May Lose to MTP) — DEV Community — Machine Learning
  2. Thinking On or Off? Gemma 4 E2B on an 8 GB RTX 3050 — DEV Community — AI
  3. Running 26B Coding Models Locally on a 6GB Laptop GPU at 45 Tokens/Sec with MAPLE and llama.cpp — DEV Community — Machine Learning
  4. Cutting LLM Fine-Tuning Memory in Pure Kotlin: Fused Linear Cross-Entropy and the JVM Vector API — DEV Community — Machine Learning
  5. RAMDeck Architecture Analysis: llama.cpp RPC, Distributed LLM Memory, and SBC Compatibility — DEV Community — Machine Learning
  6. Goodfire identifies small neuron groups steering grammar and arithmetic in Llama 3.1 8B — AlphaSignal
  7. llama.cpp finally has a 1.0 release. Check your old integrations before upgrading. — r/artificial
  8. Rotate K/V read order for better L2 cache hit rates by gaugarg-nv · Pull Request #32407 · ggml-org/llama.cpp — r/LocalLLaMA

Read the Daily Brief: the day's most important AI stories →