1.58 Bits vs FP8: What Ternary Weights Actually Buy, and What They Break
The headline is always the same: a model that runs on a laptop, at a fraction of the energy, with almost no quality loss. The number behind it is bits per weight, pushed from sixteen down to eight, four, and now below two. The direction is right. The mechanism, however, is routinely misdescribed, a…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-02 01:40 · DEV Community — Machine Learning
1.58 Bits vs FP8: What Ternary Weights Actually Buy, and What They Break