Researchers say LLMs can edit neural network weights directly, boosting small model's math ability

Researchers report that GPT-6 Astra edited just 0.016% of Qwen3.5-0.8B's weights, raising its math score from 7.9% to 48.1% without gradient-based training.

Read the full story at Techmeme ↗

Timeline · 2 reports

1. 2026-11-02 20:18 · r/singularity
   MIT researchers say GPT-6 Astra improved a small Qwen model’s math score from 7.9% to 48.1% by directly editing just 0.016% of its weights, without gradient-based training.
2. 2026-11-02 20:00 · Techmeme
   Researchers say LLMs can be good at natively reading and writing neural network weights; GPT-6 Astra edited Qwen3.5-0.8B's weights to make it better at math (Rikiya Takehi)