LoRA vs full fine-tuning: when is LoRA good enough?
LoRA is good enough for most fine-tuning: on normal-sized instruction and reasoning datasets, and in reinforcement learning, it matches full fine-tuning when it covers every layer and uses a higher learning rate. Nodus runs both on its nodus/sft training runtime, where the switch is one parameter,…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-13 02:41 · DEV Community — Machine Learning
LoRA vs full fine-tuning: when is LoRA good enough?