The Surprising Effectiveness of Deleting Weights in LLM Post-Training
How little of a pretrained large language model (LLM) has to change for it to acquire new capabilities? We find that zeroing fewer than 0.05% of its weights, with no other modification, matches full fine-tuning (FFT) at scale across three LLM post-training regimes: reinforcement learning with verif…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-11-10 19:44 · r/LocalLLaMA
The Surprising Effectiveness of Deleting Weights in LLM Post-Training