AINewsnow

We built better quants for agentic Qwen3.8-27B - 15% lower KL than Unsloth at the same size

Hey everyone, we just released BaseQuant V1 for Qwen3.8-27B at Base Compute. Three GGUF sizes: 10.93, 16.41 and 20.82 GB. In our held-out tests, they had 17–34% lower KL divergence from BF16 than similarly sized Unsloth quants. Would love for you to try them and tell us how they hold up in your eve…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-22 11:29 · r/LocalLLM
    We built better quants for agentic Qwen3.8-27B - 15% lower KL than Unsloth at the same size

More stories

  1. OlmoEarth v1.3: State-of-the-art embeddings for the whole planet — Allen Institute for AI (Ai2)
  2. Uber brings ChatGPT Work to all employees with OpenAI — OpenAI News
  3. Claude Duet is Anthropic's answer to Meta Muse and OpenAI Dots — Engadget
  4. Write your own training loop — without managing GPUs — with Amazon SageMaker training session APIs — AWS Machine Learning Blog
  5. Stop guessing auto scaling targets for TTS on Amazon SageMaker AI — AWS Machine Learning Blog
  6. Cognition Becomes First Customer for NVIDIA Vera Rubin NVL72 on CoreWeave Cloud — CoreWeave Blog
  7. Ex-OpenAI Science Head Kevin Weil Launches Startup With $215 Million — Bloomberg AI
  8. Meta agrees deal to keep Zuckerberg in California despite wealth tax proposal — Financial Times AI

Get the daily brief of stories like this at 6:30 every morning →