Could 4 M5 Ultra, 512 gb Mac Studios Run Kimi K3? How Many TPS Would it Get?

Using RDMA and a TB5 mesh network. Curious as if this works it would probably be the cheapest way to run the model completely locally - albeit anything of this price (probably around $60k) shouldn't be called cheap at all.

Read the full story at r/LocalLLM ↗

Timeline · 1 report

2026-10-07 02:12 · r/LocalLLM
Could 4 M5 Ultra, 512 gb Mac Studios Run Kimi K3? How Many TPS Would it Get?

More stories

Together Link: open models in the harness you already use. Start with one command today. — Together AI Blog
Mistral Large 4 beats Qwen 3.8 Max and Kimi K3 on Terminal-Bench — r/singularity
Need maybe say "Use llama.cpp" — r/LocalLLaMA
Built a gateway so you can call DeepSeek, Qwen, Kimi, GLM, MiniMax with one key — USD billing, OpenAI-compatible — r/LocalLLM
Anthropic Subscriptions Offer 5x+ More Value Than OpenAI — SemiAnalysis
Introducing Mistral Large 4 — Mistral AI News
Sharing AI progress in mathematics — OpenAI News
Mistral Says Its New AI Model ‘Le Chonk’ Is the Best Open-Weight Offering Outside of China — Wired AI

Get the daily brief of stories like this at 6:30 every morning →