AINewsnow

Anyone running PrismML’s Bonsai 27B on an Arc A770 16GB or B580? Speed and software support?

Hi all, I’m planning a 24/7 home server (Linux, Proxmox) for local inference and I’m choosing between an Intel Arc A770 16GB, an Arc B580 12GB and a used RX 6800. The model I want to run is Ternary Bonsai 2 27B (or the first Ternary Bonsai 27B), since the ~7 GB footprint fits on a 12-16 GB card wit…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-15 09:44 · r/LocalLLM
    Anyone running PrismML’s Bonsai 27B on an Arc A770 16GB or B580? Speed and software support?

More stories

  1. Anthropic reports $16.8 billion Q3 revenue ahead of planned IPO — New York Times Technology
  2. NVIDIA RTX Spark Superchip Outperforms Apple M5 Max in AI Benchmarks — Engadget
  3. Google launches its ‘universal' online shopping cart ahead of the holidays — The Verge AI
  4. Bank of America hired 1,000 contractors to patch software flaws exposed by Anthropic's Mythos — CNBC Technology
  5. Anthropic warns AI models may self-replicate on IoT devices within months — Financial Times AI
  6. Amazon Launches Bee AI Wearables With $12 Monthly Subscription — Bloomberg AI
  7. Amazon launches new Bee personal AI devices starting at $75 — TechCrunch AI
  8. An intelligent new shopping cart — Google Gemini Blog

Get the daily brief of stories like this at 6:30 every morning →