AINewsnow

I built BitRun: A standalone runner for 1-bit LLMs (100–127 t/s on Apple Silicon & 40–45 t/s on PC CPUs with zero compile)

I built BitRun because I wanted to run 1-bit ternary LLMs on ordinary laptops without melting my battery, spinning up a dedicated GPU, or wrestling with complex build environments. Right now, BitRun gives you 98 to 127 tokens/sec on an Apple M4 Pro CPU and 40 to 45 tokens/sec on an Intel Core i5 PC…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-14 11:58 · r/LocalLLaMA
    I built BitRun: A standalone runner for 1-bit LLMs (100–127 t/s on Apple Silicon & 40–45 t/s on PC CPUs with zero compile)

More stories

  1. Apple launches HomeView smart display and HomePod mini 2 — The Guardian AI
  2. China approves Alibaba AI models for Apple Intelligence in iPhone Duo — South China Morning Post Tech
  3. Apple Research Explores Tri-Modal Masked Diffusion Models — Apple Machine Learning Research
  4. Apple Research Proposes Method for Detecting Code-Switching in Speech Models — Apple Machine Learning Research
  5. Apple TV 4K 2026 features always-on Siri and AI responses — ZDNET AI
  6. Apple Introduces HomeView, a $299 Tablet for the Home — New York Times AI
  7. LLMs and Humans Both Challenged in Machine Translation Quality Annotation — Apple Machine Learning Research
  8. Apple Research Proposes Distributed Virtual GPU Cloud Using Idle Silicon — Apple Machine Learning Research

Get the daily brief of stories like this at 6:30 every morning →