AINewsnow

MACaQ 🐒: Open-source quantizer with a "refinement" mode for existing GGUFs + custom llama.cpp & vLLM kernels

Sharing MACaQ 🐒 , a fast, open-source quantization framework that outperforms popular Unsloth and Bartowski GGUFs on low-bit KLD while maintaining model size and inference speed. Also supports activation quantization and text-to-image and text-to-video models. Some key features: GGUF Refinement Mo…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-13 12:56 · r/LocalLLM
    MACaQ 🐒: Open-source quantizer with a "refinement" mode for existing GGUFs + custom llama.cpp & vLLM kernels

More stories

  1. Bengali costs 6.3x the tokens English does — I counted — DEV Community — AI
  2. llama.cpp ships v1.0.0 and promises API breaks only in majors — DEV Community — AI
  3. ggml v1.0.0: What the New Stable API Means for Local ML Developers — DEV Community — Machine Learning
  4. Clover-35B-A3B on llama.cpp: what "AR mode only" means, and a GGUF that answers in Gs — DEV Community — AI
  5. RTX 5090 32GB + 64GB RAM — What local LLM would should I run? — r/LocalLLM
  6. A 120B Model Ran About 4x Faster Than a 27B One: 8 Local LLMs on a Surface Laptop Ultra — DEV Community — AI
  7. DeepSeek API Expansions, Local 284B MoE Runs, and New Developer Tooling — DEV Community — Machine Learning
  8. Can First-Person Word Frequency Track Models’ Stance Maintenance Under Pressure? — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →