AINewsnow

10 coding agents, one Qwen 3.8 27B, same llama-server: tokens and cache reuse differ more than pass rates

Part 2 of my agent test (part 1 was a 4B model) Hardware I used: MacBook Pro M5 Max, 64 GB. Qwen 3.8 27B Q4 on llama.cpp, thinking off. Setup same model and server for everyone 5 small coding tasks, each with a little trap each agent locked in a sandbox: it can only touch its own folder and only ta…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-30 00:34 · r/LocalLLaMA
    10 coding agents, one Qwen 3.8 27B, same llama-server: tokens and cache reuse differ more than pass rates

More stories

  1. I wrote a Rust inference engine for Qwen models on a 12 GB GPU, decode is ~1.7x llama.cpp on my RTX3060 — r/LocalLLM
  2. Apple Intelligence to launch in China in December with iOS 27.3 and Alibaba's Qwen — The Verge AI
  3. LFM3-1.7b seems impressive — r/LocalLLaMA
  4. Qwen3.8 27b (Q6) casually breaking reCAPTCHA — r/LocalLLM
  5. 769 tok/s on a Single RTX 4090: Spark-X2.6-1.7B DSpark — DEV Community — Machine Learning
  6. Halving the KV Cache Doubles Capacity and Buys 1% of Speed — DEV Community — Machine Learning
  7. Am I Crazy Or GLM 5.3 Flash is Hilarious? — r/LocalLLaMA
  8. How we fit a 27B model on a 12 GB laptop GPU — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →