I let qwen3.8-max butcher FreeToken to get qwen3.8-flash-next-nvfp4 working on 4x3090 and it did
Repo is here https://github.com/rpochepov/FreeToken got about 66t/s no MTP which could be a big win, it is working on it now
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-22 12:07 · r/LocalLLM
I let qwen3.8-max butcher FreeToken to get qwen3.8-flash-next-nvfp4 working on 4x3090 and it did