AINewsnow

Agentic work is 1-2 tokens per second but chat is 180+?

This story is from 2026-09-17. It is preserved in the archive; the latest stories are on the live feed.

It is completely possible I have fundamentally misunderstood how agents work vs chat, I hope someone can tell me what I am misunderstanding or doing wrong. My pc: rtx 4070 super with 12gb vram 64 gb ddr4 ram cpu:9900k nvme ssd for os and ai work I am running qwen 3.8 iq3 xs with a context at 32k an…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-09-17 03:44 · r/LocalLLM
    Agentic work is 1-2 tokens per second but chat is 180+?

More stories

  1. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  2. Qwen 3.8 27B Running for 63 hours on a RTX 3090 to solve the Riemann hypothesis — r/LocalLLM
  3. Qwen q4 3.8 27b 16 tok/s 32k RTX 3060 :D — r/LocalLLM
  4. US government website used Chinese model the FBI called "malicious" — Ars Technica AI
  5. Deployed Qwen 3.6 35B A3B on a single DGX Spark supporting 12 concurrent users at 262K context. Are there better ways to optimize this? — r/LocalLLM
  6. Qwen Developers on X: "Qwen-Image 2.1 is going open source" — r/StableDiffusion
  7. Ternary Bonsai 2 27B — r/LocalLLaMA
  8. M2 Mac ultra128gb Qwen flash next — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →