0.1 Bits Per Weight Is Not 0.1 Bits Per Weight: Where the Bytes Go in Sub-2-Bit LLMs
This story is from 2026-10-21. It is preserved in the archive; the latest stories are on the live feed.
TL;DR Recent coverage of Samsung Research's LittleBit repeats its headline: Llama2-13B at 0.1 bits per weight , under 1 GB. The paper (arXiv 2506.13771, NeurIPS 2025) supports the number, but the number is a property of the transformer blocks only. Three things follow when you account for the whole…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-21 16:06 · DEV Community — Machine Learning
0.1 Bits Per Weight Is Not 0.1 Bits Per Weight: Where the Bytes Go in Sub-2-Bit LLMs