AINewsnow

I tested Qwen3.8 27B KLD for 21 Models at 9 different KV quants that fit on 16GB VRAM (189 benchmarks).

This story is from 2026-10-15. It is preserved in the archive; the latest stories are on the live feed.

I calculated KLD and perplexity for Qwen3.8 27B models that fit 16GB VRAM: See comments for the benchmarks. Reddit filters keeps deleting the post. Conclusion: q5_1/q5_1 is almost always better than q8_0/q4_0 or q4_0/q8_0. There is very little difference between q8_0/q4_0 and q4_0/q8_0 q4_0/q8_0 is…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-15 08:11 · r/LocalLLaMA
    I tested Qwen3.8 27B KLD for 21 Models at 9 different KV quants that fit on 16GB VRAM (189 benchmarks).

More stories

  1. I tested Qwen3.8 27B KLD for 21 Models at 9 different KV quants that fit on 16GB VRAM (189 benchmarks). — r/LocalLLM
  2. SMBs Will Drive Next Boom — Perplexity CEO Aravind Srinivas: Small Companies + AI-Native = Huge Money, No Fortune 500 Logos Needed — r/artificial
  3. My mechanical keyboard's software only runs on Windows, so I had Opus 5.5 reverse engineer it and port it into a Rust app for Linux — r/GeminiAI
  4. Anthropic warns AI models may self-replicate on IoT devices within months — Financial Times AI
  5. Amazon Launches Bee AI Wearables With $12 Monthly Subscription — Bloomberg AI
  6. Amazon launches new Bee personal AI devices starting at $75 — TechCrunch AI
  7. Anthropic reports $16.8 billion Q3 revenue ahead of planned IPO — New York Times Technology
  8. CoreWeave details hybrid agent approach for anomaly detection — CoreWeave Blog

Get the daily brief of stories like this at 6:30 every morning →