How are you guys thinking about context now, and building around it?
Not asking for anyone’s secrets of the trade, I’m more curious how people are thinking about context now that newer models chew through huge amounts of it for reasoning. the TLDR: I’m starting to think of context less as working memory and more as a temp scratchpad to start each step. I’m running a…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-25 01:31 · r/LocalLLaMA
How are you guys thinking about context now, and building around it?