AINewsnow

Compaction

Running QWEN-27B-GGUF Quant 4, 64k context window with Unsloth/Hermes on a 5070ti, 32GB DDR5, Ryzen 7 9850X3D Everything is going really well but the compaction has become a problem. I imagine that loading the context of each previous conversation is killing me. After a while the compaction message…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-03 14:24 · r/LocalLLM
    Compaction

More stories

  1. Viggle turbo v0.3 for Qwen image 2.1: less grain and cleaner surfaces — r/StableDiffusion
  2. Qwen4Exp: add MTP by am17an · Pull Request #29761 · ggml-org/llama.cpp — r/LocalLLaMA
  3. How smart is the IQ3 family of Qwen 3.8 Flash Next for coding tasks? — r/LocalLLaMA
  4. Pi extension: Skip reasoning with local Qwen 27B and proceed to answer right now — r/LocalLLaMA
  5. Direct weight surgery from Qwen-4B to 0.8B on an 8GB RX 580: why editing all layers breaks everything, and how 4 anchor blocks fixed it — r/machinelearningnews
  6. I made my iPhone a second GPU for my 24 GB MacBook: Qwen 3.8 27B prefills 29–44% faster & my holds part of the CTX window. — r/LocalLLaMA
  7. What is your experience with bonsai 2 27b? — r/ArtificialInteligence
  8. Gufo performance .... 70tps Qwen 3.8 27b but you need to read the fine print. — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →