AINewsnow

Ternary Bonsai 2 Family: 2B, 4B, & 9B based on Qwen 3.5

This story is from 2026-10-15. It is preserved in the archive; the latest stories are on the live feed.

Going to try these out to see if they have the same looping behaviors that other Bonsai models have had. Still requires their fork of llama.cpp (branch prism) so dont expect it to work with vanilla llama.cpp. Edit: You can use with regular llama.cpp! Will see if there is some way to support this fo…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-15 21:45 · r/LocalLLaMA
    Ternary Bonsai 2 Family: 2B, 4B, & 9B based on Qwen 3.5

More stories

  1. Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming — r/LocalLLM
  2. Qwen Ships Qwen3-VL 8B Locally, Seeing Images and Video in 5 GB — AlphaSignal
  3. Developer Mert Cobanov Runs llama.cpp on a Jailbroken PS5 — AlphaSignal
  4. Flux 2 Klein Vs Flux 3 Klein — r/StableDiffusion
  5. Community evaluates Qwen 3.8 Flash Next performance and quantization trade-offs — r/LocalLLaMA
  6. NPCs can talk back now | from universal modder on X: "Introducing NPCTalk: make the NPCs of any game talk in realtime. I made every NPC in GTA V answer to me in character, in their own cloned voice, in under 1s, and they act on what you say. — r/agi
  7. Running Qwen Code on a Custom OpenAI-Compatible API: modelProviders, a 41,000-Character First Request and Retries That Keep Going for Minutes — DEV Community — AI
  8. Liquid AI's LFM2.5-24B Runs 184 Tokens per Second for Local Agents — AlphaSignal

Get the daily brief of stories like this at 6:30 every morning →