AINewsnow

Need advice : 128k ctx kv cache q8/q4 or 64k ctx q8/q8 with pi-observational-memory ?

Hello, I am currently playing with ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ3_S.gguf on my 16G Vram 9070XT and I was wondering if I am doing a mistake. I used to use the model with q8/q4 and 128k context. It worked more or less well but when compaction triggers it was blocking everything for 2-3 minu…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-20 09:14 · r/LocalLLM
    Need advice : 128k ctx kv cache q8/q4 or 64k ctx q8/q8 with pi-observational-memory ?

More stories

  1. DHS Orders DeepSeek Technology Removed From Federal Civilian IT Systems — Wall Street Journal Technology
  2. DeepSeek open-sources DeepInfer, its internal production stack designed to accelerate inference, optimize chip performance, and reduce energy and compute costs — Techmeme
  3. From training to serving: Reflection’s Beam on CoreWeave — CoreWeave Blog
  4. DeepSeek v4.1-Flash-1017 new version — r/singularity
  5. Welcome to Google Gemini 4 Argon — Towards Data Science
  6. Homebase Launches AI Assistant to Fill Shifts and Ease Hiring and Payroll — Unite.AI
  7. You need a better headshot. — OpenAI YouTube
  8. DeepSeek Unveils Open-Source Tool to Help Cut AI Operating Costs — Bloomberg AI

Get the daily brief of stories like this at 6:30 every morning →