This is fun. I finally got to follow up on a RemindMe comment. Back on March 25 of this year, six months ago, no model was getting even 1% on ARC-AGI-3. A commenter asked if we could see 75% at $2 cost. Well, the cost is still high ($26.1k), but GPT-6-Astra-Max was able to get 62.7% (no harness!)

And the commenter did technically say "a year from now", so to me that makes the 62.7% less than six months later (Astra was released earlier this month, on September 3), even more impressive. And of course with a lightweight memory adapter*, the benchmark is simply saturated. Those saturation scor…

Read the full story at r/singularity ↗

Timeline · 1 report

1. 2026-09-25 18:19 · r/singularity
   This is fun. I finally got to follow up on a RemindMe comment. Back on March 25 of this year, six months ago, no model was getting even 1% on ARC-AGI-3. A commenter asked if we could see 75% at $2 cost. Well, the cost is still high ($26.1k), but GPT-6-Astra-Max was able to get 62.7% (no harness!)