Draft acceptance tweaks?
This story is from 2026-09-07. It is preserved in the archive; the latest stories are on the live feed.
What can I do to get more from MTP if anything? Or am I sitting at the expected range. Thanks /opt/llama.cpp/build/bin/llama-server \ --host 10.210.44.126 \ --port 11434 \ --model /opt/models/Qwen3.6-35B-A3B-MTP-UD-Q8_K_XL.gguf \ --mmproj /opt/models/mmproj-35B-A3B-BF16.gguf \ --ctx-size 100352 \ -…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-07 02:19 · r/LocalLLaMA
Draft acceptance tweaks?