AINewsnow

Qwen3.8-27B Q6 on one RTX 5090: 69 → 100 tok/s short, 35 → 64 tok/s at 120K context, just by leaving LM Studio for a native llama.cpp build (full benchmarks + recipe)

I spent a day tuning a single-user agentic setup (Codex CLI -> local model) on my own box, measuring everything. Sharing the numbers, the recipe, and the traps that cost me the most time. Setup GPU: RTX 5090 32 GB CPU: Ryzen 9 9950X3D2, RAM: 64 GB DDR5-6000, Windows 11 Model: Qwen3.8-27B abliterate…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-26 11:35 · r/LocalLLM
    Qwen3.8-27B Q6 on one RTX 5090: 69 → 100 tok/s short, 35 → 64 tok/s at 120K context, just by leaving LM Studio for a native llama.cpp build (full benchmarks + recipe)

More stories

  1. Full DeepSeek-V4.1-Flash-1017 (510 GB, original weights) on a 64 GB RAM + RTX 3060 12 GB PC: up to 7.4 tok/s, 98.3% agreement with the full model. Engine released (Apache-2.0) — r/LocalLLM
  2. Qwen 3.8 Flash Next Gyro Coder is out! — r/LocalLLaMA
  3. I created a benchmark to test local LLMs on your Snapdragon NPU (open source) — r/LocalLLM
  4. boro64/Ternary-Nemotron-3.5-Lightning-30B-A3B-GGUF · Hugging Face — r/LocalLLaMA
  5. I built my first RAG project using Whisper, BGE-M3 and Ollama — what should I improve? — r/learnmachinelearning
  6. Gemma 4 26B-A4B on a 16 GB Mac: 33/40 on TypeScript tasks, 31 tok/s, offline, using Google's stock file — r/huggingface
  7. DSpark on an RX 7900 GRE: Qwen3-8B goes from 59 to 133 tok/s in llama.cpp — r/LocalLLM
  8. qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →