Abliterated Ternary-Bonsai-2-27B (1.58-bit GGUF) + a write-up of how it was done
Sharing an abliteration of Ternary-Bonsai-2-27B — a natively ternary (~1.58-bit) reasoning model, so it's ~8 GB and runs on a single 24 GB GPU. Reasoning ( ) is intact and capability stays close to stock (PPL +8.4%). Because this model is ternary + Hadamard-rotated and has no backward pass in ggml,…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-25 16:35 · r/LocalLLM
Abliterated Ternary-Bonsai-2-27B (1.58-bit GGUF) + a write-up of how it was done