Qwen3.8-27B in 12.06 GiB on a 16 GB card, benchmarks included
Yesterday I posted a 32B pack and the replies were interesting about it being old completely overlooking benchmarks. A lot of quants "fit" on 16 GB, obviously... Almost none of them post what it cost. A screenshot of a model loading is not a benchmark and neither is its tokens per second performanc…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-11-09 15:22 · r/LocalLLM
Qwen3.8-27B in 12.06 GiB on a 16 GB card, benchmarks included