How many agents can 2×4090 actually run at once? Three weeks of llama.cpp concurrency data — soft cap 5 @ 64k, hard cap 9, and why.
This story is from 2026-09-08. It is preserved in the archive; the latest stories are on the live feed.
I'm the CTO of a mid-size nonprofit, and I run a local Qwen stack as a coding subagent for that work — partly on principle (a fair amount of what I handle shouldn't leave the building), partly because the token bill for bulk code work adds up fast on a nonprofit budget. Over three weeks I benchmark…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-08 22:21 · r/LocalLLaMA
How many agents can 2×4090 actually run at once? Three weeks of llama.cpp concurrency data — soft cap 5 @ 64k, hard cap 9, and why.
More stories
- M2 Mac ultra128gb Qwen flash next — r/LocalLLM
- Multi-hour llama.cpp optimization experiments on Qwen MoE models, patches, benchmarks, and reproduction guides — r/LocalLLM
- The bear can dance: Qwen 3.8 27B on one 3090 for 3 weeks — r/LocalLLaMA
- CUDA: enable sparse fa for qwen4 by am17an · Pull Request #28770 · ggml-org/llama.cpp — r/LocalLLaMA
- M1 Max 32GB, trying to run Qwen 3.8 27B at decent speeds and context — r/LocalLLaMA
- [Guide / Weights] Qwen 3.8 27B on Intel Arc: Why IQ quants crawl at 8 tok/s, why Q4_K outpaces sub-4bpw on Battlemage, and clean RCO GGUFs (16GB & 24GB) — r/LocalLLM
- My Version of Jev running locally, playing doom. — r/LocalLLM
- Two node BC250 cluster comparison of Qwen3.6 vs Qwen 3.8 — r/LocalLLM
Get the daily brief of stories like this at 6:30 every morning →