AINewsnow

I open-sourced OpenBonsai: compress your own BF16 models and fine-tunes into ~2 GB ternary GGUFs

I've been experimenting with tiny models for WebBrain , my open-source browser agent. The long-term goal is to run as much intelligence as possible locally, ideally through WebGPU. One approach I've been particularly interested in is Prism ML's Ternary Bonsai: compressing a 9B model to roughly 2 GB…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-29 08:13 · r/LocalLLaMA
    I open-sourced OpenBonsai: compress your own BF16 models and fine-tunes into ~2 GB ternary GGUFs

More stories

  1. 8 examples of Gemini 4 Argon in action — Google Gemini Blog
  2. Google launches Gemini 4 Carbon with a ‘significant leap’ in cybersecurity — The Verge AI
  3. Anthropic reveals plans for blockbuster IPO — Sky News Technology
  4. Sources: DeepSeek and Moonshot AI heavily relied on GPT-6 Astra distillation to train models like Kimi K3.1 Pro and V4.1-Flash 1017, after Anthropic's crackdown (The Information) — Techmeme
  5. Alogic Launches Crux Wireless Mouse For Productivity And AI Workflows — Forbes AI
  6. Running Qwen 3.8 Flash Next — r/LocalLLaMA
  7. Tencent targets Southeast Asia as launch pad for AI agent WorkBuddy amid tough local market — South China Morning Post Tech
  8. API credits, now in ChatGPT Pro and Business plans — OpenAI YouTube

Get the daily brief of stories like this at 6:30 every morning →