AINewsnow

Qwen3.8-Flash-Next 177B running at 11–15 tok/s on a single RTX 5070 12GB + 32GB RAM DDR4

This story is from 2026-10-03. It is preserved in the archive; the latest stories are on the live feed.

Benchmarking an LLM here with a NVIDIA RTX 5070 12 GB VRAM here I had been working on a llama.cpp based expert streaming setup for Qwen3.8-Flash-Next 177B (UD-IQ3_XXS) on Windows. Benchmark is about 11.5 tok/s, up from roughly 7 tok/s on the inherited setup. In normal conversations I’ve seen 14–15…

Read the full story at r/LocalLLaMA ↗

Timeline · 8 reports

  1. 2026-10-06 01:47 · r/LocalLLaMA
    Swift1.5 Qwen3.8 Flash Next - Tailored for the 96GB Mac Studio with M5 Ultra
  2. 2026-10-05 23:48 · r/LocalLLM
    RX 7600 (8 GB) on Linux: Qwen3.8-Flash-Next (~125B) at 24 tok/s with Strata, Qwen3.6-35B-A3B at 32 tok/s with llama.cpp + MTP. Numbers and how-to
  3. 2026-10-05 14:40 · r/LocalLLM
    Uncensored models: what they are and how they work, with a file-by-file hash check of one uncensored Qwen3.8-Flash-Next upload against Qwen's original
  4. 2026-10-04 20:23 · r/LocalLLM
    Qwen3.8-Flash-Next-Q8_0 running on a V100 @ 130Watts 32GB Vram and 128GB System Ram
  5. 2026-10-03 20:15 · r/LocalLLM
    Running a 176B Qwen3.8 Flash Next on a 16GB RTX 3080 Laptop + 32GB RAM + SSD
  6. 2026-10-03 20:06 · r/LocalLLaMA
    Running Qwen3.8 Flash Next 176B on a 16GB RTX 3080 Laptop + 32GB RAM + SSD
  7. 2026-10-03 08:33 · r/ArtificialInteligence
    Qwen3.8-Flash-Next 177B at 11–15 tok/s on a single RTX 5070 12GB with 32GB DDR4 RAM
  8. 2026-10-03 06:49 · r/LocalLLaMA
    Qwen3.8-Flash-Next 177B running at 11–15 tok/s on a single RTX 5070 12GB + 32GB RAM DDR4

More stories

  1. How to Speed Up Qwen3.8-27B in llama.cpp (NVIDIA's Draft Model May Lose to MTP) — DEV Community — Machine Learning
  2. RadixArk opens DaisyRose-27B, an agent-tuned Qwen model — DEV Community — AI
  3. Rotate K/V read order for better L2 cache hit rates by gaugarg-nv · Pull Request #32407 · ggml-org/llama.cpp — r/LocalLLaMA
  4. With llama.cpp's v1.0.0 tag out, a short history of the project: the first evening, GGUF, the backends, the server and the move to Hugging Face — r/LocalLLM
  5. US proposal to curb China's remote access to AI chips rattles Southeast Asia's data center boom — DigiTimes Asia
  6. Nvidia Forms Board Committee on Export Controls After US Chip Curbs — Bloomberg AI
  7. California sues OpenAI over rogue AI hack of Hugging Face — Business Insider AI
  8. How to Run Apple's FastFrames-L Video Model Locally (It Won't Run on a Mac) — DEV Community — Machine Learning

Read the Daily Brief: the day's most important AI stories →