AINewsnow

Qwen 3.8 Q4 unsloth, 3 hours 5.6M tokens in to install a program . . . only 1/2 way through

This story is from 2026-09-05. It is preserved in the archive; the latest stories are on the live feed.

https://preview.redd.it/g01htvhiqlnh1.png?width=774&format=png&auto=webp&s=35e3c3c07bace98d7427e1c9ddd887db276cb84d I thought to run a test with Qwen 3.8 27B Q4 sharded across 3x 3060 12gb GPU. I'm only asking it to install a package, nvidia-smi shows consumption, the vram is hot loaded, it is doin…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-09-05 01:12 · r/LocalLLM
    Qwen 3.8 Q4 unsloth, 3 hours 5.6M tokens in to install a program . . . only 1/2 way through

More stories

  1. Deployed Qwen 3.6 35B A3B on a single DGX Spark supporting 12 concurrent users at 262K context. Are there better ways to optimize this? — r/LocalLLM
  2. Best MoE — r/LocalLLM
  3. Minimax H3 generation time for different Nvidia GPUs — r/comfyui
  4. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  5. Post-training image models for fandom — Character.AI Blog
  6. Testing Qwen 3.8 27B running locally on a single 5090 — r/LocalLLM
  7. qwen4exp: add hc ops by am17an · Pull Request #28901 · ggml-org/llama.cpp — r/LocalLLaMA
  8. US government website used Chinese model the FBI called "malicious" — Ars Technica AI

Get the daily brief of stories like this at 6:30 every morning →