I created a benchmark to test local LLMs on your Snapdragon NPU (open source)
Coverage of "I created a benchmark to test local LLMs on your Snapdragon NPU (open source)" from 2 sources, with a live timeline of who reported what and when.
Read the full story at r/LocalLLM ↗
Timeline · 2 reports
- 2026-10-26 11:01 · r/LocalLLM
I made an open-source app to run LLMs on the Snapdragon X NPU, with a benchmark, auto-picked models and GenieX vs Foundry Local - 2026-10-26 10:59 · r/LocalLLM
I created a benchmark to test local LLMs on your Snapdragon NPU (open source)
More stories
- Full DeepSeek-V4.1-Flash-1017 (510 GB, original weights) on a 64 GB RAM + RTX 3060 12 GB PC: up to 7.4 tok/s, 98.3% agreement with the full model. Engine released (Apache-2.0) — r/LocalLLM
- Qwen 3.8 Flash Next Gyro Coder is out! — r/LocalLLaMA
- Qwen3.8-27B Q6 on one RTX 5090: 69 → 100 tok/s short, 35 → 64 tok/s at 120K context, just by leaving LM Studio for a native llama.cpp build (full benchmarks + recipe) — r/LocalLLM
- boro64/Ternary-Nemotron-3.5-Lightning-30B-A3B-GGUF · Hugging Face — r/LocalLLaMA
- I built my first RAG project using Whisper, BGE-M3 and Ollama — what should I improve? — r/learnmachinelearning
- Gemma 4 26B-A4B on a 16 GB Mac: 33/40 on TypeScript tasks, 31 tok/s, offline, using Google's stock file — r/huggingface
- DSpark on an RX 7900 GRE: Qwen3-8B goes from 59 to 133 tok/s in llama.cpp — r/LocalLLM
- qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp — r/LocalLLaMA
Get the daily brief of stories like this at 6:30 every morning →