AINewsnow

A 125B Model at 100 tok/s on One RTX 4090? Here's What the HN Hype Leaves Out

This story is from 2026-10-05. It is preserved in the archive; the latest stories are on the live feed.

A repo called Strata just hit 788 points on Hacker News with a headline that sounds like a typo: Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100 tok/s. A 125B-parameter model. On a gaming GPU. At 100 tokens per second. Is it real? Yes. Is it what the title implies? Not quite.…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-05 09:02 · DEV Community — AI
    A 125B Model at 100 tok/s on One RTX 4090? Here's What the HN Hype Leaves Out

More stories

  1. How to Speed Up Qwen3.8-27B in llama.cpp (NVIDIA's Draft Model May Lose to MTP) — DEV Community — Machine Learning
  2. Qwen4-Max Cuts AI Task Costs, but Gives Up Qwen’s Open-Model Edge — DEV Community — AI
  3. RadixArk opens DaisyRose-27B, an agent-tuned Qwen model — DEV Community — AI
  4. Run Mobilerun with local and cheap models Ollama, DeepSeek, Qwen, OpenRouter — DEV Community — Machine Learning
  5. An attached file told the model to delete all customers. In OpenWebUI, it tried — DEV Community — AI
  6. RadixArk Doubles A Free AI Model's Coding Score In Just 18 Days — DEV Community — Machine Learning
  7. Qwen Image: Wan2.1 flf2v — 2 Workflows, Read From the Graphs — DEV Community — AI
  8. The 12-Day Open-Source Pledge: Alibaba Locks Qwen4-Max Behind a Closed API — DEV Community — Machine Learning

Read the Daily Brief: the day's most important AI stories →