capy-flash: Qwen3.8-Flash-Next (125B MoE) in full NVFP4 on two 16 GB consumer GPUs
First, kudos to Strata . It inspired this project, and while I was building it Strata got much faster and added NVFP4 support, which was my main reason for starting. By then I was too far in to stop, so I finished it. capy-flash is the evolution of my ninfer-tp2 engine. It still runs Qwen3.8-27B as…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-15 20:20 · r/LocalLLaMA
capy-flash: Qwen3.8-Flash-Next (125B MoE) in full NVFP4 on two 16 GB consumer GPUs