A Small Transformer Trained in 1.5 Hours Beat Many LLMs on ARC
This story is from 2026-09-02. It is preserved in the archive; the latest stories are on the live feed.
Mithil Vakde trained a small transformer from scratch in 1.5 hours on a rented RTX 5090. The compute cost came to about 67 cents. The model scored 44% on the ARC-AGI-1 public eval, one point behind TRM's 45% and in the same band that left DeepSeek R1, o3-mini, and Gemini 2.5 Pro behind when the TRM…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-09-02 06:56 · DEV Community — Machine Learning
A Small Transformer Trained in 1.5 Hours Beat Many LLMs on ARC