AINewsnow

Qwen 3.8 Flash Next GSQ-RCO IQ_3S at 70tok/s decode/1900tok/s prefill on 2013 Xeon E5-1680v2, 128GB quad channel DDR3-1866 ECC, and an EVGA 3090 FTW3

Yes I know the 3090 is carrying but I’m still amazed I can run such a model locally at these speeds. Running Harness^2 on some local projects I previously tasked to Claude.

Read the full story at r/LocalLLM ↗

Timeline · 8 reports

  1. 2026-10-23 16:16 · r/LocalLLaMA
    agentionai/Qwen3.8-Flash-Next-Gyro-Coder-GGUF · Hugging Face
  2. 2026-10-23 15:41 · r/LocalLLaMA
    Qwen 3.8 Flash Next Gyro Coder is out!
  3. 2026-10-23 03:56 · r/LocalLLaMA
    Deepseek V4.1-1017 - doing okay on RDNA2/3 + DDR4
  4. 2026-10-22 23:47 · r/LocalLLaMA
    Qwen 3.8 Flash Next (129 GB) is better than 2.6 bpw DeepSeek V4.1 Flash 1017 (187 GB + 203 GB Engram)
  5. 2026-10-22 15:27 · r/LocalLLM
    Qwen 3.8 Flash Next (Q4) got stuck on this loop for hours. I wonder if this is the AI equivalent of having a nightmare and not being able to wake up
  6. 2026-10-22 03:44 · r/LocalLLaMA
    What's your favorite medium to large (~50-150b params) MOE model? Aside from Qwen flash next.
  7. 2026-10-22 03:18 · r/LocalLLaMA
    I have an answer! Qwen Flash Next IQ2 IS better than Q8 of 27B (for me).
  8. 2026-10-22 01:54 · r/LocalLLM
    Qwen 3.8 Flash Next GSQ-RCO IQ_3S at 70tok/s decode/1900tok/s prefill on 2013 Xeon E5-1680v2, 128GB quad channel DDR3-1866 ECC, and an EVGA 3090 FTW3

More stories

  1. Benchmark: Recursive's Flint 40B A2.5B Q4 achieves 128 tok/s on MacBook Pro M4 Pro 48GB using Kapitsa, an open-source Apple Silicon optimized engine, Claude/Codex/Pi/OpenCode compatible. — r/LocalLLaMA
  2. "Claude Speak" from Qwen models? — r/LocalLLM
  3. ThursdAI - Oct 22 - AI finds all the vulnerabilities, Claude Duet, DeepSeek drops Infer & more AI news — ThursdAI
  4. Is 128GB RAM worth it? — r/LocalLLaMA
  5. Same price per token, 2.7x the bill: what I learned trying to forecast my LLM API costs — r/LocalLLM
  6. I made Gemini, ChatGPT, Claude, etc. into FREE text-to-speech sites — perfect for audiobooks and more! — r/Bard
  7. I may be late to the game but This is fun. — r/LocalLLaMA
  8. Tried running 748B DeepSeek-V4.1-Flash on a €2k PC — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →