d3-edge (0.6B) fine-tuned outperformed d3 (27B) decision model
Took vLLM-SR d3-edge (0.6B), fine-tuned it with simple SFT + LoRA, and compared it against the much larger d3 (27B). With just a few thousand training examples, the 0.6B model actually outperformed the 27B model on typed decisions and nearly matched it on Banking77. I strongly believe we should be…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-16 14:38 · r/LocalLLaMA
d3-edge (0.6B) fine-tuned outperformed d3 (27B) decision model