Bonsai 2 27B - quantized 3.8 27B - 98% intelligence of the fp16 ! True ?
What do you guys think about it ? I have yet to try it. I i’ve tried the previous version and it seemed OK and wondering if they claim of 98+ % intelligence of the FP 16 model is true or not anybody has any experience. Feel free to share! I’ll post my update after I do some basic testing submitted…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-18 23:43 · r/LocalLLM
Bonsai 2 27B - quantized 3.8 27B - 98% intelligence of the fp16 ! True ?