Anyone running Qwen3.8-Flash-Next on 64GB of VRAM? What is your experience? Quality and speed compared to 27B?
I was building my machine for months to run Qwen3.8-27B in FP8 with context enough for multiple agents. I ended up with four 5070ti. Now it runs great, around 200tok/sec with 750K context (I can reliable run 4 agents parallel with around 200K context, so my total tok/sec generation is over 800). I'…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-30 16:02 · r/LocalLLM
Anyone running Qwen3.8-Flash-Next on 64GB of VRAM? What is your experience? Quality and speed compared to 27B?