Tuned Strata config, 2000 PP and 95-105 mean tg
TLDR: IQ3_S Qwen3.8-Flash-Next, RTX 4090 + 48 GB + Ryzen 3900X, Windows, 200k context. Ran essentially a grid search on a ton of flags: decode 97 → 142 tok/s (+45%) for three flags. Most relevant: --adapt-async 1, --kv-resident 20480, STRATA_ADAPT_LAG=2. Worst: --expert-cache is in MiB not slots (−…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-25 21:12 · r/LocalLLaMA
Tuned Strata config, 2000 PP and 95-105 mean tg