Continual learning on 4 days of real news: an 8B model keeps day 1 at 90.7% vs 26.7% for LoRA, GSM8K unchanged (sealed test) [R]
I've been working on continual learning. Each night a model learns that day's news into its weights, then gets asked about it the next morning with nothing in the prompt. One day turns out to be easy. A plain LoRA trained on practice questions gets 93 to 96% the next morning. The hard part is the n…
Read the full story at r/MachineLearning ↗
Timeline · 1 report
- 2026-11-07 14:03 · r/MachineLearning
Continual learning on 4 days of real news: an 8B model keeps day 1 at 90.7% vs 26.7% for LoRA, GSM8K unchanged (sealed test) [R]