MIT CSAIL Reports GPT-6 Astra Edited Qwen3.5-0.8B Weights, Boosting Math Scores
MIT CSAIL's 'Sparks of Weight-Space Programming' shows GPT-6 Astra editing 131,072 weights (0.016%) of Qwen3.5-0.8B without gradients or fine-tuning, fixing a math loop and lifting MATH-500 from 7.9% to 48.1% and GSM8K from 13.8% to 67.1%.
Read the full story at Techmeme ↗
Timeline · 24 reports
- 2026-11-04 12:56 · DEV Community — Machine Learning
Weight-Space Programming - 2026-11-04 10:33 · DEV Community — Machine Learning
Weight-Space Programming: how GPT-6 Astra edited Qwen's weights and took MATH-500 from 7.9% to 48.1% - 2026-11-04 03:27 · DEV Community — Machine Learning
Bagaimana GPT-6 Astra Memperbaiki Qwen3.5-0.8B dengan Mengedit 0,016% Bobotnya - 2026-11-04 02:26 · r/mlscaling
Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights - 2026-11-03 19:14 · The Algorithmic Bridge
The Dawn of a New AI Paradigm: Weight-Space Programming - 2026-11-03 18:48 · r/LocalLLaMA
I tried MIT's "weight-space programming" on my own use case: Claude rewrote 8 neurons of Gemma 4 12B to change how it translates one Italian tense - 2026-11-03 17:54 · DEV Community — AI
Weight-Space Programming Works: An LLM Fixed Qwen's Math Loop by Editing 0.016% of Its Weights - 2026-11-03 14:30 · DEV Community — Machine Learning
GPT-6 Astra Edited Qwen3.5-0.8B's Weights. The MATH-500 Jump Was a Loop Fix - 2026-11-03 14:16 · DEV Community — Machine Learning
Hydrogen-1.0 MIT Open Weights: Gated BF16, NVFP4 262K Context Cliff, and Vendor FSR vs GPT-6 Astra - 2026-11-03 12:38 · DEV Community — Machine Learning
What counts as feedback in weight-space programming? - 2026-11-03 11:15 · DEV Community — AI
Astra’s Weight‑Space Programming: A Practical Guide to Tuning Qwen - 2026-11-03 09:06 · r/LocalLLaMA
[Paper] Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights - 2026-11-03 05:35 · Analytics India Magazine
MIT Researchers Show LLMs Can Read and Edit Neural Network Weights Without Retraining - 2026-11-03 05:35 · Latent Space
[AINews] LLMs can read & write neural network weights: "Weight Space Programming" cuts Autoresearch out of the RSI loop - 2026-11-02 22:16 · VentureBeat AI
'Like gene editing for neural networks': MIT researchers used GPT-6 Astra to edit Qwen's open weights directly, boosting math performance - 2026-11-02 21:36 · r/LocalLLM
MIT researchers say GPT-6 Astra improved a small Qwen model’s math score from 7.9% to 48.1% by directly editing just 0.016% of its weights, without gradient-based training. - 2026-11-02 21:25 · r/LocalLLaMA
GPT-6 Astra Edits Qwen Weights: MATH-500 7.9% to 48.1% - 2026-11-02 21:00 · Ethan Mollick (X)
If this holds up, it is big: "We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math - 2026-11-02 20:18 · r/singularity
MIT researchers say GPT-6 Astra improved a small Qwen model’s math score from 7.9% to 48.1% by directly editing just 0.016% of its weights, without gradient-based training. - 2026-11-02 20:18 · r/MachineLearning
Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights [R] - 2026-11-02 20:00 · Techmeme
Researchers say LLMs can be good at natively reading and writing neural network weights; GPT-6 Astra edited Qwen3.5-0.8B's weights to make it better at math (Rikiya Takehi) - 2026-11-02 19:24 · Lobsters AI
Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights - 2026-11-02 19:15 · r/LocalLLaMA
Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights - 2026-11-02 18:45 · r/singularity
Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights