Context compaction strategy?
Hi I use local llms everyday, to help with task like pdf ingestion and wiki creation, sometimes coding and so on. I have a limited rig 2x3060 12gb and 64gb ram ddr4 I use qwen3.8 flash next for planning things and qwen3.8 27b ISTA-DASLab to work, all these with pi harness. I installed smart-compact…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-21 14:26 · r/LocalLLM
Context compaction strategy?