AINewsnow

Qwen 3.8 27B setup help on my system? (System details in body..)

This story is from 2026-09-06. It is preserved in the archive; the latest stories are on the live feed.

Hi. I downloaded Qwen3.8 27B Q8 KL and ran it on my system but I’m getting terrible generation speed of 1.1t/s. I’ve been running it with unsloth studio and llama.cpp. And with Qwen3.8 thinking like Socrates, it sometimes takes upto 2 hours to accomplish simple writes which makes it inefficient. Pl…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-09-06 02:21 · r/LocalLLM
    Qwen 3.8 27B setup help on my system? (System details in body..)

More stories

  1. qwen4exp: add hc ops by am17an · Pull Request #28901 · ggml-org/llama.cpp — r/LocalLLaMA
  2. Multi-hour llama.cpp optimization experiments on Qwen MoE models, patches, benchmarks, and reproduction guides — r/LocalLLM
  3. Intel releases OpenVINO 2026.4 — r/LocalLLaMA
  4. dual 7900 xtx - some guy made a pretty optimized fork of lamacpp optimized for this setup Qwen 3.8 Q8 at 82 tokens / seconds decode — r/LocalLLaMA
  5. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  6. Post-training image models for fandom — Character.AI Blog
  7. Testing Qwen 3.8 27B running locally on a single 5090 — r/LocalLLM
  8. US government website used Chinese model the FBI called "malicious" — Ars Technica AI

Get the daily brief of stories like this at 6:30 every morning →