AINewsnow

I open-sourced OpenBonsai: compress your own BF16 models and fine-tunes into ternary GGUFs

I've been experimenting with tiny models for WebBrain , my open-source browser agent. The long-term goal is to run as much intelligence as possible locally, ideally through WebGPU. One approach I've been particularly interested in is Prism ML's Ternary Bonsai: compressing a 9B model to roughly 2 GB…

Read the full story at r/huggingface ↗

Timeline · 1 report

  1. 2026-10-29 17:53 · r/huggingface
    I open-sourced OpenBonsai: compress your own BF16 models and fine-tunes into ternary GGUFs

More stories

  1. Anthropic files paperwork for IPO as Blackstone flags junk-grade rating — New York Times Technology
  2. DeepSeek open-sources Super-agent, a proactive autonomous coding agent prototype — Techmeme
  3. Mistral releases weights for trillion-parameter Le Chonk model with 1M-token context — Wired AI
  4. Brazil courts data centers with tax breaks and cheap power as US opposition grows — Fortune AI
  5. Nace.AI Open-Sources Drex-Max v1, a 27B Multimodal Decision Model for Local Use — r/LocalLLM
  6. Big Tech sheds nearly $900bn as AI spending fears trigger market rout — Financial Times AI
  7. Beginner lesson plan offers 15-minute introduction to using ChatGPT — Tom's Guide AI
  8. Foxconn hints at new OpenAI tie-up for AI hardware, says no AI bubble — Economic Times Tech

Get the daily brief of stories like this at 6:30 every morning →