WarpState: experimenting with dual-timescale associative memory + local attention for long-running LLMs
Hey everyone, I’m sharing a research project I’ve been working on called WarpState — an experimental language-model architecture exploring whether we can move away from storing an ever-growing history of token-level KV states and instead maintain a compact recurrent memory. The basic idea is: exact…
Read the full story at r/OpenAI ↗
Timeline · 1 report
- 2026-09-20 10:12 · r/OpenAI
WarpState: experimenting with dual-timescale associative memory + local attention for long-running LLMs