AINewsnow

Qwen3.6-35B-A3B Q4_K_M (llama.cpp) or Qwen3.8-Flash-Next Coder IQ1_M (Strata) for coding agent?

Hi, I have a RTX 5070 Ti 12GB with 32GB system RAM running on linux for coding tasks with pi coding agent as harness. I have been using since August (with 128k context) llama.cpp with Qwen3.6-35B-A3B Q4_K_M (unsloth quants) and I'm very satisfied with it. Not perfect but good enough to code a porta…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-11 20:50 · r/LocalLLM
    Qwen3.6-35B-A3B Q4_K_M (llama.cpp) or Qwen3.8-Flash-Next Coder IQ1_M (Strata) for coding agent?

More stories

  1. Llama App - Windows’ta ücretsiz indir ve yükle — Microsoft Research Blog
  2. Ten engines for one box: which local inference engine fits a 100 GB rig with two 16 GB cards? — DEV Community — Machine Learning
  3. Local LLMs for Agentic Coding: A Practical Guide for Modest Hardware — DEV Community — AI
  4. Kinetic: a new open-source LLM engine in Rust. Runs your GGUFs on Windows and Linux, replaces llama-server with the same flags — r/LocalLLM
  5. Caution about fast inference engines — r/LocalLLM
  6. Open-source method (MACaQ) beats Unsloth GGUFs! — r/LocalLLaMA
  7. Run Gemma 4 31B-it Uncensored on a 12GB GPU: Complete Local Vision & 256K Context Guide with llama.cpp, DeepSeek Harness & Hermes Agent — DEV Community — Machine Learning
  8. llama.cpp: Add FP8 KV-cache — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →