r/LocalLLaMA
We fine-tuned Qwen3.8-27B to stop overthinking. Accuracy matches the base within the confidence interval, reasoning tokens drop 60-67%, and the MTP head still works after training, so you keep speculative decoding. Same harness for both models: FP8, thinking on, 64k cap, same prompts and sampling.…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-29 15:49 · r/LocalLLM
r/LocalLLaMA