AINewsnow

Benchmark: Recursive's Flint 40B A2.5B Q4 achieves 128 tok/s on MacBook Pro M4 Pro 48GB using Kapitsa, an open-source Apple Silicon optimized engine, Claude/Codex/Pi/OpenCode compatible.

hey folks, im Ye, im one of the contributors to Kapitsa , an open source inference engine optimized specifically for Apple Silicon (all the way from M1 chips to M6) to run Qwen & Nemotron models that would fit a regular MacBook. its custom written Metal kernels, allow us to optimize each chip & for…

Read the full story at r/LocalLLaMA ↗

Timeline · 4 reports

  1. 2026-10-23 09:46 · r/huggingface
    Flint 40B-A2.5B - ABLITERATED!
  2. 2026-10-23 00:21 · r/LocalLLaMA
    Flint 40B-A2.5B vs Ornith 1.5 35B-A3B vs Nemotron 3.5 Lightning
  3. 2026-10-22 12:54 · r/LocalLLM
    Flint 40B A2.5B Q4 achieves 128 tok/s on MacBook Pro M4 Pro 48GB using Kapitsa, an open-source Apple Silicon optimized engine with custom Kernels for Flint
  4. 2026-10-22 12:17 · r/LocalLLaMA
    Benchmark: Recursive's Flint 40B A2.5B Q4 achieves 128 tok/s on MacBook Pro M4 Pro 48GB using Kapitsa, an open-source Apple Silicon optimized engine, Claude/Codex/Pi/OpenCode compatible.

More stories

  1. Qwen 3.8 Flash Next GSQ-RCO IQ_3S at 70tok/s decode/1900tok/s prefill on 2013 Xeon E5-1680v2, 128GB quad channel DDR3-1866 ECC, and an EVGA 3090 FTW3 — r/LocalLLM
  2. llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp — r/LocalLLaMA
  3. "Claude Speak" from Qwen models? — r/LocalLLM
  4. I made Gemini, ChatGPT, Claude, etc. into FREE text-to-speech sites — perfect for audiobooks and more! — r/Bard
  5. I may be late to the game but This is fun. — r/LocalLLaMA
  6. Kimi K3.1 Pro and Kimi K3.1 Pro Highspeed are available now in AI Gateway — Vercel Blog
  7. Tried running 748B DeepSeek-V4.1-Flash on a €2k PC — r/LocalLLaMA
  8. Anthropic Joins the A.I. Agent Race With Claude Duet — New York Times Technology

Get the daily brief of stories like this at 6:30 every morning →