AINewsnow

780m and Gemma 4 26b a4b

I just tested llama.cpp on an 680m igpu. Runs with 15 tokens/sec for ling 3 tiny and 9 tokens/sek for Gemma 4 e4b. Both in power saver mode. The laptop stayed cold and silent. Ling is actually useable BTW. If you have this igpu, try it out. My question: Have any of you tested Gemma 4 26b a4b on a 7…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-17 08:37 · r/LocalLLM
    780m and Gemma 4 26b a4b

More stories

  1. Unsloth's Llama 3.2 Mirror Hits 800K Downloads by Removing Meta's Login Wall — AlphaSignal
  2. V100 16GB: A 2017 GPU running a 35B vision model at 93 tok/s: Tesla V100 16 GB on Windows — r/LocalLLM
  3. llama.cpp has come a long way — r/LocalLLaMA
  4. Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming — r/LocalLLM
  5. I made llama.cpp's slot saves write only the changed chunks: a FUSE filesystem that dedups KV-cache snapshots — r/LocalLLM
  6. Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console — Hacker News Front Page
  7. Fully local, private voice + chat AI assistant (zero cloud) — Qwen3.8-27B on 2× RTX PRO — r/LocalLLM
  8. reflection/Beam-1.0-501B-A23B · Hugging Face — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →