AINewsnow

Running qwen 3.8 27B iq3 xxs on RTX 3060.

This story is from 2026-09-09. It is preserved in the archive; the latest stories are on the live feed.

Getting anywhere from 10 - 20 tps. Thinking Off . Took about 4 mins and 7 mins. Running on about "IQ3_S - 3.4375 bpw" 37.03.960.932 I slot print_timing: id 0 | task 2665 | prompt processing, n_tokens = 12516, progress = 0.98, t = 37.08 s / 337.55 tokens per second 37.04.777.411 I slot print_timing:…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-09-09 23:42 · r/LocalLLaMA
    Running qwen 3.8 27B iq3 xxs on RTX 3060.

More stories

  1. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  2. Qwen 3.8 27B Running for 63 hours on a RTX 3090 to solve the Riemann hypothesis — r/LocalLLM
  3. US government website used Chinese model the FBI called "malicious" — Ars Technica AI
  4. Is Qwen 3.8 Flash Next usable on M1 Ultra 64GB ? — r/LocalLLM
  5. Deployed Qwen 3.6 35B A3B on a single DGX Spark supporting 12 concurrent users at 262K context. Are there better ways to optimize this? — r/LocalLLM
  6. Qwen Developers on X: "Qwen-Image 2.1 is going open source" — r/StableDiffusion
  7. Ternary Bonsai 2 27B — r/LocalLLaMA
  8. “DeadGrid” now open source exclusively made with qwen 3.8 27b Q4KM — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →