AINewsnow

Half a Million Tokens of Context Still Needs an Index

This story is from 2026-09-10. It is preserved in the archive; the latest stories are on the live feed.

A thread on r/LocalLLaMA ran Qwen 3.8 27B with a 524,000-token context window on two RTX 3090s this week, holding 60 to 88 tokens per second. Two consumer GPUs, half a million tokens of context, one box. Five years ago that sentence would have been science fiction. Every milestone like this revives…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-09-10 02:41 · DEV Community — AI
    Half a Million Tokens of Context Still Needs an Index

More stories

  1. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  2. US government website used Chinese model the FBI called "malicious" — Ars Technica AI
  3. Qwen 3.8 27B Running for 63 hours on a RTX 3090 to solve the Riemann hypothesis — r/LocalLLM
  4. Deployed Qwen 3.6 35B A3B on a single DGX Spark supporting 12 concurrent users at 262K context. Are there better ways to optimize this? — r/LocalLLM
  5. Qwen Developers on X: "Qwen-Image 2.1 is going open source" — r/StableDiffusion
  6. Qwen q4 3.8 27b 16 tok/s 32k RTX 3060 :D — r/LocalLLM
  7. Qwen Image 2.1 Examples — r/StableDiffusion
  8. Qwen Image 2.1 on Comfy: Coming Soon — r/StableDiffusion

Get the daily brief of stories like this at 6:30 every morning →