Nanbeige4.3-33B Quantised GGUF
Quant ladder of Nanbeige's new 33B model from 35.2GB down to 13.7GB For 32GB hardware the sweet spot is 20.3GB AD-IQ4_XS with a top-1% of 92.0% compared to BF16
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-25 21:33 · r/LocalLLaMA
Nanbeige4.3-33B Quantised GGUF