Making the most of 64 GB RAM: Qwen3.8-Flash-Next UD-IQ4_XS on an RTX 5060 Ti 16 GB
I’m running Qwen3.8-Flash-Next UD-IQ4_XS, the Huihui v2 version, with Strata 0.1.47 on a dedicated inference node with 64 GB RAM and an RTX 5060 Ti 16 GB. I’ve set STRATA_ROUTE_TAIL_SKIP=0 to disable route tail skipping , and all benchmarks below were run with this setting. The setup has been stabl…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-23 17:38 · r/LocalLLM
Making the most of 64 GB RAM: Qwen3.8-Flash-Next UD-IQ4_XS on an RTX 5060 Ti 16 GB