Qwen3.8-Flash-Next on 2x RTX 5090 with 504 tok/s decode: QEngine 1.3.1 decodes ~1.5-1.9x faster than the next-best engine I've tried (numbers, caveats, and what still bites)
https://github.com/bpx03/QEngine (not my repo, credit goes to bpx03) QEngine was built for 3x RTX 3090s. I was able to compile for RTX 5090s. I've now run Qwen3.8-Flash-Next on the same box through four different engines. QEngine (bpx03, v1.3.1) is the fastest for single-stream decode by a clear ma…
Read the full story at r/LocalLLaMA ↗
Timeline · 4 reports
- 2026-11-01 19:01 · DEV Community — AI
After One Agent Session, Your API Key Can Sit in 8 Places. How to Check Each - 2026-11-01 12:53 · r/LocalLLM
I tried the Opus 5.5 vs GPT-6.1 Terra Blender oak tree challenge with a local Qwen3.8-Flash-Next NVFP4 on my RTX 5090 - 2026-10-31 18:29 · DEV Community — AI
Claude Opus 5.5 vs GPT-6 for coding: what one agent session actually costs - 2026-10-31 01:09 · r/LocalLLaMA
Qwen3.8-Flash-Next on 2x RTX 5090 with 504 tok/s decode: QEngine 1.3.1 decodes ~1.5-1.9x faster than the next-best engine I've tried (numbers, caveats, and what still bites)