AINewsnow

[Benchmark] Strata/Basalt runs Qwen3.8 Flash Next IQ3_S with 16GB VRAM and 55GB RAM with up to 250 tok/s generation and 5,600 tok/s prompt processing (5080, Concurrency 1)

Qwen3.8-Flash-Next IQ3_S on Basalt | RTX 5080 16 GB, Core Ultra 9 285K, 62 GB DDR5-6800 | 262K context, int8 KV Workload (prompts 5K+) PP avg (t/s) PP peak (t/s) TG avg (t/s) TG peak (t/s) VRAM RAM (engine / left free) Agent coding session (opencode, 103 requests, up to 130K ctx) 5,011 5,118 153.0…

Read the full story at r/LocalLLaMA ↗

Timeline · 2 reports

  1. 2026-10-25 06:49 · r/LocalLLM
    Lean-QwenFlash: Qwen3.8-Flash-Next (125B) running at ~20 tok/s on 16gb vram and 8gb ram via direct nvme SSD offloading
  2. 2026-10-25 03:59 · r/LocalLLaMA
    [Benchmark] Strata/Basalt runs Qwen3.8 Flash Next IQ3_S with 16GB VRAM and 55GB RAM with up to 250 tok/s generation and 5,600 tok/s prompt processing (5080, Concurrency 1)

More stories

  1. Kimi K3.1 Pro and Kimi K3.1 Pro Highspeed are available now in AI Gateway — Vercel Blog
  2. Securing our frontier model training environment — OpenAI News
  3. NCERT introduces 20-hour AI module for classes 9-12, covers deepfakes and data privacy — Mint AI
  4. Can someone help me understand the difference between ChatGPT skills, plugins, and projects? — r/ChatGPT
  5. MOSS-Image-Edit LoRA — r/StableDiffusion
  6. Block unveils Dessa, a "true speech-to-speech" AI model trained on "nothing but human conversation" that it says runs locally on a MacBook Pro M4 Max or newer — Techmeme
  7. Fired OpenAI researchers say independent safety audits aren't going well — NPR Technology
  8. Clean Energy Has a Lot Riding on the AI Data Center Boom — TIME Tech

Get the daily brief of stories like this at 6:30 every morning →