AINewsnow

I gave a frozen GPT-2 a 4 MB memory that survives across sessions: no gradients, no fine-tuning, no vector DB

This story is from 2026-08-25. It is preserved in the archive; the latest stories are on the live feed.

I spent the last weeks on a simple question: how much can a frozen LM improve at inference if you only allow it *one Hebbian matrix* no backprop, no growing index? The result: a fixed 4.2 MB matrix, written once per token as the model reads, gated by the model's own token surprise (−ln p, free at i…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-08-25 14:02 · r/LocalLLM
    I gave a frozen GPT-2 a 4 MB memory that survives across sessions: no gradients, no fine-tuning, no vector DB

More stories

  1. Meet the Data Agent in ChatGPT Work — OpenAI YouTube
  2. Microsoft and OpenAI Workers Worry About ‘Largest Theft of Labor’ in History — New York Times Technology
  3. we made a 27b model for creative writing. performs as good as claude fable 5, at a 40x cheaper price, open weights. — r/GeminiAI
  4. Anthropic mulls new AI model ahead of IPO to counter OpenAI's GPT-6 Astra, says report: What we know — Mint AI
  5. what's the state of the art recipe for running Qwen3.8-Flash-Next with a pair of 3090s and a ton of system RAM rn? — r/LocalLLaMA
  6. Gemini 4 Pro vs Fable 5 vs GPT6 Astra — r/GeminiAI
  7. I ran Claude code and Codex in parallel for 15 days. Here's what I found. — r/AI_Agents
  8. ChatGPT for Word is now available — OpenAI YouTube

Get the daily brief of stories like this at 6:30 every morning →