Ternary Bonsai 2 27B on a $250 Intel Arc B580: writes a working snake game at 108 t/s, 89 t/s at 115K context (open source)
Short version: PrismML's ternary Bonsai 2 27B runs fast on a 12 GB Intel Arc B580 with my llama.cpp SYCL branch. The video is real time: it writes a full snake game in 34 seconds, then runs it. Temperature 0, 128K context; the typing and gameplay are automated, and the generation is unedited. https…
Read the full story at r/LocalLLM ↗