AINewsnow

cpu : reduce AVX2 tiled accumulators together by trivalik · Pull Request #30296 · ggml-org/llama.cpp

More t/s on CPU, For GPU poor people

Read the full story at r/LocalLLaMA ↗

Timeline · 4 reports

  1. 2026-10-17 14:33 · r/LocalLLaMA
    CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/llama.cpp
  2. 2026-10-17 11:07 · r/LocalLLaMA
    model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request #30673 · ggml-org/llama.cpp
  3. 2026-10-16 08:28 · r/LocalLLaMA
    model : MTP support for Mellum2.1 by Xarbirus · Pull Request #30612 · ggml-org/llama.cpp
  4. 2026-10-16 07:52 · r/LocalLLaMA
    cpu : reduce AVX2 tiled accumulators together by trivalik · Pull Request #30296 · ggml-org/llama.cpp

More stories

  1. DeepSeek V4.1 Flash 1017 now available on AI Gateway — Vercel Blog
  2. reflection/Beam-1.0-501B-A23B · Hugging Face — r/LocalLLaMA
  3. Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming — r/LocalLLM
  4. Liquid AI's LFM2.5-24B Runs 184 Tokens per Second for Local Agents — AlphaSignal
  5. How to Run NVIDIA Nemotron Dory 4B Locally (Stock llama.cpp Can't Load It Yet) — DEV Community — Machine Learning
  6. Qwen Ships Qwen3-VL 8B Locally, Seeing Images and Video in 5 GB — AlphaSignal
  7. Round 3: Tested 128K context on a 3090 with real code (Django) and a novel. Finding one thing is solid, counting is hopeless — r/LocalLLM
  8. Efforts to upstream adaptive MTP depth to llama.cpp abandoned — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →