Ternary LLMs on a $250 Intel Arc: PrismML merged my B580 work, and I've been training my own tiny ternary models
I've been messing around with ternary models (weights are just -1, 0 or +1) on my Intel Arc B580 for a few weeks, and it's gone further than I expected. On the inference side, I wrote SYCL kernels and fusions so PrismML's Bonsai models run properly on Arc. PrismML reviewed it and merged it into the…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-20 12:27 · r/LocalLLM
Ternary LLMs on a $250 Intel Arc: PrismML merged my B580 work, and I've been training my own tiny ternary models