AINewsnow

RTX 5090 32GB + 64GB RAM — Qwen3.8 Flash-Next IQ3_XXS Running at 700K Context Without a Single Session Compaction

I managed to build METEOR STRIKE using Qwen3.8 Flash-Next IQ3_XXS with a 700K context window on my RTX 5090 (32GB VRAM) + 64GB RAM setup. I did give the model additional instructions and corrections along the way, but the entire project was completed in one continuous session without a single conte…

Read the full story at r/LocalLLM ↗

Timeline · 3 reports

  1. 2026-10-12 08:37 · r/LocalLLaMA
    Qwen3.8-Flash-Next on six 3090s with vLLM: 7 users at 262k, 6.5k t/s prefill, 57 t/s decode solo / 206 t/s aggregate with all 7 generating. Fixes for the upstream included.
  2. 2026-10-12 00:58 · r/LocalLLM
    IQ3_XXS Qwen3.8-Flash-Next 125B at full 262K context on one 3090 and 32GB of RAM — my config and my numbers, and I'd like to see yours
  3. 2026-10-11 11:12 · r/LocalLLM
    RTX 5090 32GB + 64GB RAM — Qwen3.8 Flash-Next IQ3_XXS Running at 700K Context Without a Single Session Compaction

More stories

  1. I clustered two old Android phones to run a 27B LLM locally. Bypassed RAM limits via C++ RPC split and Hadamard Ternary math (No overheating) — r/LocalLLM
  2. Research: Gemma 4 E2B on a Pixel 8 Pro (Tensor G3) with llama.cpp — r/LocalLLM
  3. Qwen 27B at ~20 tok/s on a jailbroken PS5's GPU. I forked PS5LM and turned it into a native app — r/LocalLLM
  4. Why AnythingLLM is moving from Ollama to Lemonade and llama.cpp — r/LocalLLaMA
  5. Quartermaster 1.7 update now lets you run llama.cpp's new decision models (/v1/systemone) with a playground tab — r/LocalLLaMA
  6. I built Harness Studio — an open-source desktop app for running Hugging Face models locally. Looking for feedback and contributors. — r/huggingface
  7. An 80B MoE (Qwen3-Next, 48 GB GGUF) answering in a Chrome tab: llama.cpp's WebGPU backend, experts paged in from disk — r/LocalLLaMA
  8. Models keeps unloading from GPU — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →