First time fine-tuning: my LoRA made a 2B model worse, and the mistakes taught me more than the wins
I’m not an ML engineer. I build a small desktop app that runs Gemma 4 E2B offline, and I wanted to teach it a few things it’s bad at. So I tried LoRA with MLX on my MacBook. Writing down what happened in case it helps someone else starting out. What I did right (by luck): before training I wrote a…
Read the full story at r/learnmachinelearning ↗
Timeline · 1 report
- 2026-10-29 03:09 · r/learnmachinelearning
First time fine-tuning: my LoRA made a 2B model worse, and the mistakes taught me more than the wins