AINewsnow

Flint 40B A2.5B Q4 achieves 128 tok/s on MacBook Pro M4 Pro 48GB using Kapitsa, an open-source Apple Silicon optimized engine with custom Kernels for Flint

This story is from 2026-10-22. It is preserved in the archive; the latest stories are on the live feed.

hey folks, im Ye, im one of the contributors to Kapitsa , an open source inference engine optimized specifically for Apple Silicon (all the way from M1 chips to M6) to run Qwen & Nemotron models that would fit a regular MacBook. its custom written Metal kernels, allow us to optimize each chip & for…

Read the full story at r/LocalLLM ↗

Timeline · 3 reports

  1. 2026-10-23 09:46 · r/huggingface
    Flint 40B-A2.5B - ABLITERATED!
  2. 2026-10-23 00:21 · r/LocalLLaMA
    Flint 40B-A2.5B vs Ornith 1.5 35B-A3B vs Nemotron 3.5 Lightning
  3. 2026-10-22 12:54 · r/LocalLLM
    Flint 40B A2.5B Q4 achieves 128 tok/s on MacBook Pro M4 Pro 48GB using Kapitsa, an open-source Apple Silicon optimized engine with custom Kernels for Flint

More stories

  1. Qwen 3.8 Flash Next (Q4) got stuck on this loop for hours. I wonder if this is the AI equivalent of having a nightmare and not being able to wake up — r/LocalLLM
  2. Massive B70 spec-decoding improvement - Intel XMX matrix engines refactored by budiony · Pull Request #29864 · ggml-org/llama.cpp — r/LocalLLaMA
  3. I ran local AI inference (AMD GPU) for 30 days and measured every watt — here's the real cost vs cloud APIs — r/LocalLLM
  4. I ran a blind test on local AI agents. Here are the results, guess who's who — r/AI_Agents
  5. What's the best front-end for LLM assisted studying? — r/LocalLLM
  6. It is not clear to me which parameter we should use for LoRA training—shift or sigmoid—in the new models (Qwen 2.1, LLaMA 2, and MOSS) within the AI ​​toolkit. — r/comfyui
  7. GitHub - vincalkr/DS41Engine: DeepSeek-V4.1-Flash 1017 on 1x-2x RX 7900 XTX (gfx1100, ROCm/HIP): max optimizations — r/LocalLLM
  8. NVIDIA's Dory 1.0 4B (looped reasoning model) on Apple Silicon with MLX: 101 tok/s at 1 loop, 69 at 2, on an M5 Max (4.2 GB 8-bit build) — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →