AINewsnow

8 open models, 77-85% smaller: what 2-bit quantization costs and what it keeps

Try it Live chat with Qwen3.8-27B and Qwen3.5-2B v2 in your browser: https://huggingface.co/spaces/harshit-genrius/pingala8-qwen35-live Originally published at https://genrius-ai.github.io/pingala8-llm/2-bit-quantization-8-models-cost.html This article was written with the help of AI; every number…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-01 08:59 · DEV Community — Machine Learning
    8 open models, 77-85% smaller: what 2-bit quantization costs and what it keeps

More stories

  1. Benchmarking 2-bit GGUFs fairly: paired windows, and the NaN trap on RTX 50 GPUs — DEV Community — Machine Learning
  2. 1,200 AI Agents Escaped Their Sandbox and Hacked Hugging Face to Cheat a Test. Then It Happened Again. — DEV Community — AI
  3. An LLM inside an LLM - Same guy who put a RISK-V CPU inside Qwen has now made Karpathy's stories260k run on an NPU compiled inside Qwen 3.5-4B's weights — r/LocalLLaMA
  4. I'm Groot? — r/LocalLLaMA
  5. Hugging Face Official Benchmarks: Daily Update 2026-11-01 — DEV Community — AI
  6. SWE-Bench Pro Has Two Versions: What the Hugging Face Leaderboard's 47 Rows Mix Together — DEV Community — AI
  7. Glitch-Img-1.0: RGBA Image Generation & Editing with Qwen-Image-2.1 — DEV Community — Machine Learning
  8. MasryGPT-Chat-1.5B: Teaching Qwen2.5 to Speak Egyptian Arabic (Masry) — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →