AINewsnow

QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases

Two months ago we released a fully quantized NVFP4 Qwen3.8-27B trained with QUASAR. We've since trained QUASAR checkpoints for a bunch of other recent models: Qwen3.5-4B, Gemma 4 E4B and 12B, and Muse Glimmer 30B, in NVFP4 for vLLM and Q4_0 GGUF for llama.cpp / Ollama / LM Studio. The code and a pr…

Read the full story at r/LocalLLaMA ↗

Timeline · 2 reports

  1. 2026-10-15 19:02 · r/huggingface
    QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases
  2. 2026-10-15 18:55 · r/LocalLLaMA
    QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases

More stories

  1. train the best model you can on your mac in one hour — r/learnmachinelearning
  2. Problems with Tesla V100 SXM2 — r/LocalLLaMA
  3. Meta releases open weights for 816B-parameter Muse Spark Open model — AWS Machine Learning Blog
  4. Gemini 4 Argon: Built to solve your hardest problems — Google AI Blog
  5. P100 (sm_60) patches for llama.cpp: +42% decode and +74% short-prefill on a 2×P100 tensor split — r/LocalLLM
  6. Qwen3.8FN vLLM vs. llama.cpp vs Ninfer6000 — r/LocalLLaMA
  7. I built Harness Studio — an open-source desktop app for running Hugging Face models locally. Looking for feedback and contributors. — r/huggingface
  8. Why rogue agents demand a global response — The Deep View

Get the daily brief of stories like this at 6:30 every morning →