AINewsnow

KQuant - new quantization technique, 3.7× better quants for Qwen Flash Next 180B, Qwen 27B, 35B, 9B (measured in KL-divergence reduction) (MLX)

hey folks, im Alish, an ml engineer from Nace (folks behind Drex, an open source decision family model that hit #1 in Artificial analysis in decision index 2.1). Recently my cto gave me task to optimize quants for qwen4, so i dialed my uni proffesor from UoT and span up my Fable 5.2 and we cooooook…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-11-12 10:47 · r/LocalLLaMA
    KQuant - new quantization technique, 3.7× better quants for Qwen Flash Next 180B, Qwen 27B, 35B, 9B (measured in KL-divergence reduction) (MLX)

More stories

  1. Abliteration technique removes safety filters from local open-weight AI models — InfoWorld AI
  2. Qwen 3.8 27B: Run It Locally on One GPU with LM Studio — DEV Community — Machine Learning
  3. Amazing... Every Word You Just Said Was Wrong. — DEV Community — AI
  4. I fine-tuned Qwen 2.5 (3B) with Unsloth to build CyberAgent: An offline AI security agent with 57 tools — DEV Community — AI
  5. Qwen 3.6 27b is "degenerate" in layer 3 of the J-space — r/LocalLLM
  6. Qwen 3.8 FN gsq rco IQ3S is better than new Unsloth IQ4XS — r/LocalLLM
  7. You can now train your own LLMs with less memory, on your gaming GPUs — r/LocalLLM
  8. Qwen Code 1.0 Is Here — and It's Not Just a CLI Anymore — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →