Qwen3.8 flash next + exllamav3 + hermes is amazing
I know there is nothing new with what I am saying but I recently started with hermes agent (it’s been a while I wanted to but did not have the time). Qwen3.8fn 6bpw exl3 (from turboderp) on a 6x3090 (I assume lower quants on lower number of gpus work same) gives me around 80-120t/s with good pp, an…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-26 10:24 · r/LocalLLaMA
Qwen3.8 flash next + exllamav3 + hermes is amazing