AINewsnow

~188k warm ~60–67 tok/s: Qwen3.8-Flash-Next NVFP4 with Strata on a single RTX PRO 4500 32GB + 64GB DDR5.

This story is from 2026-10-05. It is preserved in the archive; the latest stories are on the live feed.

Coverage of "~188k warm ~60–67 tok/s: Qwen3.8-Flash-Next NVFP4 with Strata on a single RTX PRO 4500 32GB + 64GB DDR5." from 6 sources, with a live timeline of who reported what and when.

Read the full story at r/huggingface ↗

Timeline · 6 reports

  1. 2026-10-06 05:39 · r/LocalLLaMA
    unsloth/Qwen3.8-Flash-Next-GGUF is being updated
  2. 2026-10-06 01:47 · r/LocalLLaMA
    Swift1.5 Qwen3.8 Flash Next - Tailored for the 96GB Mac Studio with M5 Ultra
  3. 2026-10-05 19:39 · r/LocalLLM
    Qwen3.8-Flash-Next Q4 vs Qwen3.8 27B Q5 on single R9700 (32GB) + 64GB RAM: 2x128k context, almost similar performance
  4. 2026-10-05 14:40 · r/LocalLLM
    Uncensored models: what they are and how they work, with a file-by-file hash check of one uncensored Qwen3.8-Flash-Next upload against Qwen's original
  5. 2026-10-05 11:11 · r/huggingface
    ~188k warm ~60–67 tok/s: Qwen3.8-Flash-Next NVFP4 with Strata on a single RTX PRO 4500 32GB + 64GB DDR5.
  6. 2026-10-05 11:09 · r/LocalLLM
    ~188k warm ~60–67 tok/s: Qwen3.8-Flash-Next NVFP4 with Strata on a single RTX PRO 4500 32GB + 64GB DDR5.

More stories

  1. How to Speed Up Qwen3.8-27B in llama.cpp (NVIDIA's Draft Model May Lose to MTP) — DEV Community — Machine Learning
  2. RadixArk opens DaisyRose-27B, an agent-tuned Qwen model — DEV Community — AI
  3. With llama.cpp's v1.0.0 tag out, a short history of the project: the first evening, GGUF, the backends, the server and the move to Hugging Face — r/LocalLLM
  4. California sues OpenAI over rogue AI hack of Hugging Face — Business Insider AI
  5. Thinking On or Off? Gemma 4 E2B on an 8 GB RTX 3050 — DEV Community — AI
  6. Qwen4-Max Cuts AI Task Costs, but Gives Up Qwen’s Open-Model Edge — DEV Community — AI
  7. Running 26B Coding Models Locally on a 6GB Laptop GPU at 45 Tokens/Sec with MAPLE and llama.cpp — DEV Community — Machine Learning
  8. Run Mobilerun with local and cheap models Ollama, DeepSeek, Qwen, OpenRouter — DEV Community — Machine Learning

Read the Daily Brief: the day's most important AI stories →