AINewsnow

Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels.

Models on HF: https://huggingface.co/collections/prism-ml/bonsai-2-small WebGPU demo: https://huggingface.co/spaces/webml-community/ternary-bonsai-2-hermes-webgpu

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-15 20:09 · r/LocalLLaMA
    Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels.

More stories

  1. Black Forest Labs releases open-weights FLUX 3 Image Klein model — Hugging Face Blog
  2. Granite Switch 4.1 offers chat, decisions, and speech in one endpoint — Hugging Face Blog
  3. Anthropic taps nonprofits METR and SecureBio to help assess risks and safety practices — CNBC Technology
  4. Flux 3 VS Krea 2 + Edit lora — r/StableDiffusion
  5. Yet Goal Solution - Music Video (Hugging Face Incident) — r/huggingface
  6. The last few weeks have been the most technologically concentrated period if time I have so far witnessed. — r/singularity
  7. "Which models fit on my GPU?" : I made a tool that answers it for any Hugging Face model, including GGUF quants and RAM offload — r/LocalLLM
  8. Alibaba gets 6x more open-weights downloads on Hugging Face than any other lab — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →