How to squeeze the Max Token from M1 Max 64gb?
For last 9 months, been using cloud frontier 99% the from Gemini Flash Pro, Claude, Deepseek, Groq & Cerebras. Ready to give 32B, 70B, 120B another try. Was getting decent 45 token/sec on 7B Llama MLX, but 7B is too simple for most task. I loaded Gwen 32B, get some errors on LM Studio. Which are…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-21 00:51 · r/LocalLLaMA
How to squeeze the Max Token from M1 Max 64gb?