An LLM edited a small model's weights directly and its math score rose 6x
TL;DR GPT-6 Astra, a frontier LLM, edited 0.016% of Qwen3.5-0.8B's weights directly, with no training run. MATH-500 went from 7.9% to 48.1%. The authors read most of that gain as unblocking: the base model kept running into its token limit instead of finishing. Astra also read, repaired and wrote s…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-05 01:07 · DEV Community — Machine Learning
An LLM edited a small model's weights directly and its math score rose 6x