AINewsnow

Kapitsa: open-source Apple Silicon optimized Metal engine built for Qwen and Nemotron. See benchmarks of Qwen 27B, Nemotron + 8 other models on an M1 Pro (16GB), M4 Pro (48GB) and M5 Max (128GB)

hey, my name is Ye, I vibecode at Nace.ai and we do a lot of work with enterprises, and a lot of the time we're inside their networks with no internet access and outdated cloud hosted models. considering we work on macbooks, we have built Kapitsa, an open-source (Apache 2.0) inference engine for Ap…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-19 07:04 · r/LocalLLaMA
    Kapitsa: open-source Apple Silicon optimized Metal engine built for Qwen and Nemotron. See benchmarks of Qwen 27B, Nemotron + 8 other models on an M1 Pro (16GB), M4 Pro (48GB) and M5 Max (128GB)

More stories

  1. 3 Models, 4 Inference Engines, 4 Macs, on Apple Silicon for Image / Video Generation — r/StableDiffusion
  2. I don't get the qwen 3.8 flash next hype — r/LocalLLaMA
  3. OpenMOSS releases MOSS-Image — r/LocalLLaMA
  4. Some insights on using Qwen-Image 2.1 — r/comfyui
  5. Tried out Gemini 4 Argon Medium on Antigravity. Burnt 66% of its WEEKLY quota and performed worse than both GPT 6.1 Sol Medium and Claude 5.5 Opus Medium — r/GeminiAI
  6. Basalt: NVFP4 + faster prefill for Qwen3.8 Flash-Next on Blackwell (single 5090) — r/LocalLLaMA
  7. NPCs can talk back now | from universal modder on X: "Introducing NPCTalk: make the NPCs of any game talk in realtime. I made every NPC in GTA V answer to me in character, in their own cloned voice, in under 1s, and they act on what you say. — r/agi
  8. Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →