Further inference tuning for higher context window with 0 hallucination/memory loss?
This story is from 2026-09-02. It is preserved in the archive; the latest stories are on the live feed.
Further inference tuning for higher context window with 0 hallucination/memory loss? It’s been almost 3 days of constantly tuning my model, unsloth MTP Qwen3.6 35B-A3B Q4\_K\_M, with the help of Claude, and we’ve finally come to a quick conclusion I’m still hoping there are more commands or setting…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-02 08:02 · r/LocalLLM
Further inference tuning for higher context window with 0 hallucination/memory loss?