AINewsnow

200+ tok/s peaks with Qwen3.8-Flash-Next on a 5080 + 4060 Ti and 32 GB of RAM (Strata fork)

This story is from 2026-10-03. It is preserved in the archive; the latest stories are on the live feed.

Strata runs Qwen3.8-Flash-Next on gaming PCs, but with 32 GB of RAM its low-RAM mode only works on one GPU. Split the model across two cards and the experts that don't fit in VRAM get read from the SSD. My 4060 Ti sat next to the 5080 doing nothing. So I forked it. The RAM copy of the experts now w…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-03 14:50 · r/LocalLLM
    200+ tok/s peaks with Qwen3.8-Flash-Next on a 5080 + 4060 Ti and 32 GB of RAM (Strata fork)

More stories

  1. OpenAI launches GPT-6.2 Astra and Sol as Google ships Gemini 4 Neon and Microsoft unveils MAI Code 2 — OpenAI News
  2. Anthropic debuts on Wall Street with record $81.3 billion IPO, hitting $2 trillion valuation — Anthropic (X)
  3. Google launches Gemini 4 Neon and opens Genie 4 world model to Gemini API developers — Google DeepMind YouTube
  4. AWS expands SageMaker AI with data preparation tools and cross-Region inference routing — AWS Machine Learning Blog
  5. A soaring debut for Anthropic's stock is not enough to carry Wall Street, and indexes drop — Washington Post AI
  6. Google books Blue Origin's New Glenn for 2029 launch of AI server satellites — Google: The Keyword
  7. AWS expands Amazon Bedrock AgentCore with cost, networking, identity, and tooling updates — AWS Machine Learning Blog
  8. AWS expands SageMaker JumpStart with OpenTSLM, model leaderboard, and PolyAI Dialog-RSN-1 — AWS Machine Learning Blog

Read the Daily Brief: the day's most important AI stories →