If you have a M1 Ultra, please do check out this inference engine
Most Apple Silicon inference engines are tuned for standard MacBooks (16–36 GB Unified Memory, 16–32 GPU cores). When deployed on an M1 Ultra (Mac Studio with a 64-core GPU, 20 CPU cores, and 128 GB Unified Memory) and hopefully M2 Ultra as well, they leave significant compute and memory bandwidth…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-11-05 06:21 · r/LocalLLM
If you have a M1 Ultra, please do check out this inference engine