AINewsnow

Strata on a power limited 5090 and 96GB of DDR5-6400 is cranking out 150-200 tok/s decode and 5-6k prefill! Qwen3.8-Flash-Next at IQ3_S, CTX at 128k tokens (8-bit).

This story is from 2026-10-02. It is preserved in the archive; the latest stories are on the live feed.

Coverage of "Strata on a power limited 5090 and 96GB of DDR5-6400 is cranking out 150-200 tok/s decode and 5-6k prefill! Qwen3.8-Flash-Next at IQ3_S, CTX at 128k tokens (8-bit)." from 5 sources, with a live timeline of who reported what and when.

Read the full story at r/LocalLLaMA ↗

Timeline · 5 reports

  1. 2026-10-04 17:43 · r/LocalLLM
    Qwen3.8-Flash-Next (IQ2_XS) - Single 4090 + 32GB DDR5 = 512k Context (STRATA)
  2. 2026-10-04 03:13 · r/LocalLLM
    Potential hardware upgrade for Qwen3.8-Flash-Next with a 96GB DDR5 (4×24), should I keep my i5-12600K and buy a DDR5 board, or switch platform?
  3. 2026-10-03 14:50 · r/LocalLLM
    200+ tok/s peaks with Qwen3.8-Flash-Next on a 5080 + 4060 Ti and 32 GB of RAM (Strata fork)
  4. 2026-10-03 02:54 · r/LocalLLM
    Qwen3.8-Flash-Next NVFP4 at 256K context with Strata — 4,100+ prefill and up to 125 tok/s decode
  5. 2026-10-02 15:29 · r/LocalLLaMA
    Strata on a power limited 5090 and 96GB of DDR5-6400 is cranking out 150-200 tok/s decode and 5-6k prefill! Qwen3.8-Flash-Next at IQ3_S, CTX at 128k tokens (8-bit).

More stories

  1. OpenAI launches GPT-6.2 Astra and Sol as Google ships Gemini 4 Neon and Microsoft unveils MAI Code 2 — OpenAI News
  2. Anthropic debuts on Wall Street with record $81.3 billion IPO, hitting $2 trillion valuation — Anthropic (X)
  3. Google launches Gemini 4 Neon and opens Genie 4 world model to Gemini API developers — Google DeepMind YouTube
  4. AWS expands SageMaker AI with data preparation tools and cross-Region inference routing — AWS Machine Learning Blog
  5. A soaring debut for Anthropic's stock is not enough to carry Wall Street, and indexes drop — Washington Post AI
  6. Google books Blue Origin's New Glenn for 2029 launch of AI server satellites — Google: The Keyword
  7. AWS expands Amazon Bedrock AgentCore with cost, networking, identity, and tooling updates — AWS Machine Learning Blog
  8. AWS expands SageMaker JumpStart with OpenTSLM, model leaderboard, and PolyAI Dialog-RSN-1 — AWS Machine Learning Blog

Read the Daily Brief: the day's most important AI stories →