AINewsnow

vllm + p2p driver hack + qwen 3.8 27B vs llamacpp + qwen flash next ?

This story is from 2026-09-06. It is preserved in the archive; the latest stories are on the live feed.

Hi everyone I'm running four rtx 4090, 64GB ram, on a threadripper pro motherboard so all PCIe x16 ports, as a homelab machine for coding. I was migrating from vllm + qwen 3.8 27B (fp8+256k kv cache) to llamacpp + qwen flash next iq4xs + 8 bit cache 200k kv cache... until someone had to ruin my mig…

Read the full story at r/LocalLLaMA ↗

Timeline · 3 reports

  1. 2026-09-08 15:53 · r/LocalLLM
    Running Qwen 3.8 27B at Q4 on 16GB VRAM at 200K CTX at 50t/s
  2. 2026-09-07 15:25 · r/LocalLLaMA
    Are you running Qwen 3.8 27b or Qwen Flash Next?
  3. 2026-09-06 23:00 · r/LocalLLaMA
    vllm + p2p driver hack + qwen 3.8 27B vs llamacpp + qwen flash next ?

More stories

  1. qwen4exp: add hc ops by am17an · Pull Request #28901 · ggml-org/llama.cpp — r/LocalLLaMA
  2. Thank you :) Swift Qwen 3.8 27B now has 100k+ downloads, is #1 finetune and #9 model on HuggingFace Trending — r/LocalLLaMA
  3. Qwen 3.6 35b nvfp4 hot expert hack in vllm — r/LocalLLM
  4. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  5. Post-training image models for fandom — Character.AI Blog
  6. Testing Qwen 3.8 27B running locally on a single 5090 — r/LocalLLM
  7. Deployed Qwen 3.6 35B A3B on a single DGX Spark supporting 12 concurrent users at 262K context. Are there better ways to optimize this? — r/LocalLLM
  8. US government website used Chinese model the FBI called "malicious" — Ars Technica AI

Get the daily brief of stories like this at 6:30 every morning →