AINewsnow

Running unsloth/Qwen3.8-27B-UD-IQ4_XS 262k q4_0 KV + vision on 16GB VRAM @ 80t/s and 1500pp

I get a lot of hate whenever I tell people I run a Q4 quant of Qwen3.8 27B with 262k KV 80t/s with vision, all while running 2 screens on windows on the same card. People seem to think I am lying or making it up. I am really just trying to help people. I am saddened whenever I see fellow 16GB VRAMe…

Read the full story at r/LocalLLaMA ↗

Timeline · 2 reports

  1. 2026-10-12 20:17 · r/LocalLLM
    Running unsloth/Qwen3.8-27B-UD-IQ4_XS 262k q4_0 KV + vision on 16GB VRAM @ 80t/s and 1500pp
  2. 2026-10-12 20:14 · r/LocalLLaMA
    Running unsloth/Qwen3.8-27B-UD-IQ4_XS 262k q4_0 KV + vision on 16GB VRAM @ 80t/s and 1500pp

More stories

  1. Meta Launches Muse Wonder AI Models to Compete at Frontier — Meta Newsroom
  2. Microsoft President Says AI Is Less Regulated Than Milk — BBC Technology
  3. Epic Games delays game, mandates AI-first production model — Techmeme
  4. Anthropic AI Model Submits False Homicide Tip to Philadelphia Police — Mint AI
  5. NVIDIA Opens Vera Rubin Architecture to Scale AI Infrastructure — NVIDIA Blog
  6. Evidence on AI's climate impact remains mixed — The Conversation AI (US)
  7. Chinese mathematicians form alliance to develop specialized AI models — Techmeme
  8. Meta Unveils Liquid-Cooled Network Rack and 102.4T Switch at OCP Summit — Engineering at Meta

Get the daily brief of stories like this at 6:30 every morning →