Context Windows: The Model's Working Memory
This story is from 2026-08-27. It is preserved in the archive; the latest stories are on the live feed.
A context window is the maximum number of tokens a language model can process in one go. It includes the system prompt, conversation history, and the model's own output. Inside the model, self-attention and a key-value cache enforce this limit, acting as the model's working memory. When the window…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-08-27 23:00 · DEV Community — AI
Context Windows: The Model's Working Memory