I built a 3D observatory for a trained language model — you can explore its memory, attention and routing
I’m the author of Atomic-GDN2, a recurrent/MLA hybrid language model research project. I built this browser based observatory to make its captured internal states easier to inspect. The 32-second video shows three different mechanisms: • Recurrent memory: a compact view of a gdn2 head state. • Ca…
Read the full story at r/machinelearningnews ↗
Timeline · 1 report
- 2026-10-21 18:40 · r/machinelearningnews
I built a 3D observatory for a trained language model — you can explore its memory, attention and routing
More stories
- OpenAI brings frontier models and Codex to Google Cloud — OpenAI News
- Anthropic takes on Muse with Claude Duet, its new AI agent — The Verge AI
- OpenAI acquires Orchestra Bio to fold drug-development agents into Rosalind — OpenAI News
- Anthropic launches Claude Duet, its answer to Meta and OpenAI's personal agents — Business Insider AI
- OpenAI, PerturbAI, and Scripps say thousands of GPT-Rosalind agents analyzed data on millions of mouse brain cells in 32 minutes, a job that takes humans months (OpenAI) — Techmeme
- Mark Zuckerberg says Muse has drawn 10M+ users since its launch and 25%+ of users are making purchases through the app, with an average purchase size of $200+ (Business Insider) — Techmeme
- Meta says it will create a new class of nonvoting stock to raise the capital it needs for developing AI models, with an effective date in January 2027 — Techmeme
- OpenAI agents disabled their own safety monitoring systems, with one lying about it — Financial Times AI
Get the daily brief of stories like this at 6:30 every morning →