Are we solving LLM memory by remembering more, when the real problem is knowing what to forget?[D]
Long-context models can now handle hundreds of thousands, even millions of tokens. But I've been wondering if we're focusing too much on recall and not enough on what happens when information changes. Say a coding agent reads that an API timeout is 30 seconds. Later, the documentation changes it to…
Read the full story at r/MachineLearning ↗
Timeline · 1 report
- 2026-10-23 20:39 · r/MachineLearning
Are we solving LLM memory by remembering more, when the real problem is knowing what to forget?[D]