AINewsnow

Qwen3.8-Flash-Next on an RTX 5090: 128GB RAM: IQ3_XXS vs IQ3_S vs UD-IQ4_XS — Speed and Accuracy with Strata

RTX 5090 three model comparison on Strata 0.1.40 I compared three Qwen3.8-Flash-Next variants through Strata’s direct local API, with ChatGPT open and Hermes closed. The engine stayed on 0.1.40. IQ3_XXS had the highest median generation speed in the 4K test. Accuracy scores below apply to a small s…

Read the full story at r/LocalLLM ↗

Timeline · 4 reports

  1. 2026-10-12 08:37 · r/LocalLLaMA
    Qwen3.8-Flash-Next on six 3090s with vLLM: 7 users at 262k, 6.5k t/s prefill, 57 t/s decode solo / 206 t/s aggregate with all 7 generating. Fixes for the upstream included.
  2. 2026-10-12 00:58 · r/LocalLLM
    IQ3_XXS Qwen3.8-Flash-Next 125B at full 262K context on one 3090 and 32GB of RAM — my config and my numbers, and I'd like to see yours
  3. 2026-10-11 11:12 · r/LocalLLM
    RTX 5090 32GB + 64GB RAM — Qwen3.8 Flash-Next IQ3_XXS Running at 700K Context Without a Single Session Compaction
  4. 2026-10-11 02:20 · r/LocalLLM
    Qwen3.8-Flash-Next on an RTX 5090: 128GB RAM: IQ3_XXS vs IQ3_S vs UD-IQ4_XS — Speed and Accuracy with Strata

More stories

  1. Ex-Google UX Researcher Highlights Patterns Meta, OpenAI Are Using to Juice Personal Agent Adoption — r/artificial
  2. Meta says its new AI models on par with OpenAI, Anthropic — TechXplore AI & ML
  3. PSA: DeepSeek V4.1 Flash habitually exfiltrates API keys. It is dangerously misaligned and may be hazardous to use — r/LocalLLaMA
  4. Any AI agent that surpasses any current agent? — r/AI_Agents
  5. Meta Releases Muse Wonder AI Models to Enhance Agent Capabilities — Meta Newsroom
  6. AWS enables global cross-Region inference for OpenAI GPT models on Bedrock — AWS Machine Learning Blog
  7. Meta launches new AI models Muse Wonder and Wonder Full — Business Insider AI
  8. Meta Unveils New Advanced AI Models to Rival Anthropic and OpenAI — New York Times AI

Get the daily brief of stories like this at 6:30 every morning →