Rank Measures of Fine-Tuning Updates Need a Noise Baseline
arXiv:2610.22438v1 Announce Type: new Abstract: Studies of what fine-tuning does to a language model often summarise the weight update $\Delta W$ by its rank. We compare the rank measures used for this against the same measures on a random matrix of the same shape, and against two harder references…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-19 04:00 · arXiv cs.LG
Rank Measures of Fine-Tuning Updates Need a Noise Baseline