AINewsnow

A Small Transformer Trained in 1.5 Hours Beat Many LLMs on ARC

This story is from 2026-09-02. It is preserved in the archive; the latest stories are on the live feed.

Mithil Vakde trained a small transformer from scratch in 1.5 hours on a rented RTX 5090. The compute cost came to about 67 cents. The model scored 44% on the ARC-AGI-1 public eval, one point behind TRM's 45% and in the same band that left DeepSeek R1, o3-mini, and Gemini 2.5 Pro behind when the TRM…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-09-02 06:56 · DEV Community — Machine Learning
    A Small Transformer Trained in 1.5 Hours Beat Many LLMs on ARC

More stories

  1. How to use MCP in the Web Browser (ChatGPT, Claude, DeepSeek & Gemini) with Web MCP Bridge — DEV Community — AI
  2. Claude vs GPT-6.1 Terra: Half the Price. I Tested It on My Real Work. — DEV Community — AI
  3. I built a local engine to give Web AIs hands (and no, it doesn't use APIs) — DEV Community — AI
  4. Study benchmarks LLMs on alloy property prediction using Wasserstein distance severity metric — arXiv cs.LG
  5. Google turns off Gemini and Search by default for K-12 school accounts after backlash — Techmeme
  6. Google to cut off Search for schools that reject AI, drawing backlash — Forbes AI
  7. Alibaba and DeepSeek champion open-source AI as industry debates costs and risks — South China Morning Post Tech
  8. DeepSeek reportedly plans to train next-generation V5 model on Huawei Ascend chips — DigiTimes Asia

Get the daily brief of stories like this at 6:30 every morning →