AINewsnow

yeasah/Qwen3.8-27B-exl3 quants - lowest KLD of 0.0002

Noticed this new EXL3 quant of 3.8-27B which achieves lowest KLD than anyone else and does it using only 18.8 GiB VRAM for weights. Pretty impressive numbers! https://huggingface.co/yeasah/Qwen3.8-27B-exl3 maker quant KLD mean file size yeasah 6bpw 0.0002 23 GB Unsloth Q8_K_XL 0.0005 31.5 GB Minach…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-29 03:33 · r/LocalLLaMA
    yeasah/Qwen3.8-27B-exl3 quants - lowest KLD of 0.0002

More stories

  1. Sources: the US DOJ has inquired about the impact of Nvidia's Hugging Face deal on AI competition, as antitrust enforcers continue to probe Nvidia's conduct (Reuters) — Techmeme
  2. NVIDIA Nemotron 3.5 Transcribe and Granary v2: Intelligent Multilingual Transcription You Can Prompt and Adapt — Hugging Face Blog
  3. Have 8 GB of VRAM and 32 GB of RAM? You can run Qwen 3.8 Flash Next at up to 900 t/s PP and 30 t/s TG! — r/LocalLLaMA
  4. Ross Wightman's Wide ResNet Pulls 850K Monthly Downloads Three Years Later — AlphaSignal
  5. Anima Ref image : AnticPan's Anima-Role-KV vs the new ElectronGirl's Anima-Ref-Adapter — r/StableDiffusion
  6. I trained a 21B MoE (3.36B active) from scratch on 70B tokens (emergent ability observations) — r/huggingface
  7. Someone built a 32-bit RISC-V CPU directly inside Qwen's model weights so it can execute instructions internaly! — r/LocalLLaMA
  8. Diffuspace/Clover-35B-A3B-Preview · Hugging Face — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →