AINewsnow

Got Qwen3.8-Flash-Next (IQ3_XXS, 70 GB) running at 65-83 tok/s on a single 3090 with my own engine, about 3x faster than Strata on the same PC

I will release probably between tomorrow-thursday! Been working on my own inference engine for a while (calling it Forge for now), built pretty much just for this model. Finally did a proper side by side against Strata 0.1.57 on my machine and figured some of you might find the numbers interesting.…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-09 04:44 · r/LocalLLM
    Got Qwen3.8-Flash-Next (IQ3_XXS, 70 GB) running at 65-83 tok/s on a single 3090 with my own engine, about 3x faster than Strata on the same PC

More stories

  1. Google DeepMind's AlphaProof Code formally verifies Signal protocol in four weeks — Google DeepMind Blog
  2. Anthropic launches Claude Sheets, Whiteboards and Data as Fable 5.2 debuts — Anthropic (X)
  3. Google Cloud launches Gemini for Healthcare in U.S. preview — Google Cloud AI Blog
  4. The phantom life of Alice Huang, alleged Chinese spy who had affair with Nvidia CEO — CSET Georgetown
  5. Google DeepMind launches Gemini Robotics 2.5, reports 96% success in Mercedes-Benz sorting test — Google DeepMind Blog
  6. Anthropic IPO said to be multiple times oversubscribed ahead of record share sale — CNBC Technology
  7. Helsing launches Clarity, an AI military intelligence platform to rival Palantir — Financial Times AI
  8. Over 35,000 Grok-built apps found exposed online, leaking confidential data — Ars Technica AI

Get the daily brief of stories like this at 6:30 every morning →