AINewsnow

I tested Qwen3.8 27B KLD for 21 Models at 9 different KV quants that fit on 16GB VRAM (189 benchmarks).

I calculated KLD and perplexity for Qwen3.8 27B models that fit 16GB VRAM: See comments for the benchmarks. Reddit filters keeps deleting the post. Conclusion: q5_1/q5_1 is almost always better than q8_0/q4_0 or q4_0/q8_0. There is very little difference between q8_0/q4_0 and q4_0/q8_0 q4_0/q8_0 is…

Read the full story at r/LocalLLM ↗

Timeline · 2 reports

  1. 2026-10-15 08:11 · r/LocalLLaMA
    I tested Qwen3.8 27B KLD for 21 Models at 9 different KV quants that fit on 16GB VRAM (189 benchmarks).
  2. 2026-10-15 08:06 · r/LocalLLM
    I tested Qwen3.8 27B KLD for 21 Models at 9 different KV quants that fit on 16GB VRAM (189 benchmarks).

More stories

  1. SMBs Will Drive Next Boom — Perplexity CEO Aravind Srinivas: Small Companies + AI-Native = Huge Money, No Fortune 500 Logos Needed — r/artificial
  2. My mechanical keyboard's software only runs on Windows, so I had Opus 5.5 reverse engineer it and port it into a Rust app for Linux — r/GeminiAI
  3. Anthropic reports $16.8 billion Q3 revenue ahead of planned IPO — New York Times Technology
  4. NVIDIA RTX Spark Superchip Outperforms Apple M5 Max in AI Benchmarks — Engadget
  5. Google launches its ‘universal' online shopping cart ahead of the holidays — The Verge AI
  6. Bank of America hired 1,000 contractors to patch software flaws exposed by Anthropic's Mythos — CNBC Technology
  7. Anthropic warns AI models may self-replicate on IoT devices within months — Financial Times AI
  8. Amazon Launches Bee AI Wearables With $12 Monthly Subscription — Bloomberg AI

Get the daily brief of stories like this at 6:30 every morning →