AINewsnow

I built a cache-friendly context compacting plugin for OpenCode

https://github.com/lennartschoch/opencode-cache-compact The default context compacting mechanism in OpenCode strips a bunch of tokens from the beginning of the conversation (system prompt, tools etc). This is fine for hosted models, but on a local model this means you'll prefill the entire conversa…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-09-22 11:38 · r/LocalLLM
    I built a cache-friendly context compacting plugin for OpenCode

More stories

  1. Alibaba Unveils New AI Chip, Outlines Plan for Larger Model — Wall Street Journal Technology
  2. Higgsfield AI ships new video features in a day with GPT-6 Astra — OpenAI News
  3. Amazon blocks Meta’s Muse AI agent — The Verge AI
  4. Moonshot’s Kimi K3 lands on Amazon in key test for Chinese open-source AI revenue — South China Morning Post Tech
  5. Meet the Data Agent in ChatGPT Work — OpenAI YouTube
  6. OpenAI forms math advisory group as its AI resolves more than 100 open problems — TechCrunch AI
  7. AIに固有の名前・財布・行動の自由を与えたら、「道具」ではなく「住民」になると思いますか？ — r/AI_Agents
  8. British Columbia Sues OpenAI, Alleging ChatGPT Aided Mass School Shooting — Wall Street Journal Technology

Get the daily brief of stories like this at 6:30 every morning →