AINewsnow

Local model for Hermes on a 48GB M5 Pro Mac mini that’s also my daily dev machine?

This story is from 2026-10-03. It is preserved in the archive; the latest stories are on the live feed.

Before I get blasted, yes I have done research and everything keeps coming back to Qwen 3.5 at like 9B or good 'ole 3.8 27B. I am not opposed to those but I am new to the Mac LLM space and I wanted to get real user experiences. I’m new to running LLMs on Macs and mostly used to Windows/NVIDIA setup…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-03 00:10 · r/LocalLLM
    Local model for Hermes on a 48GB M5 Pro Mac mini that’s also my daily dev machine?

More stories

  1. How to Speed Up Qwen3.8-27B in llama.cpp (NVIDIA's Draft Model May Lose to MTP) — DEV Community — Machine Learning
  2. US proposal to curb China's remote access to AI chips rattles Southeast Asia's data center boom — DigiTimes Asia
  3. Nvidia Forms Board Committee on Export Controls After US Chip Curbs — Bloomberg AI
  4. Alibaba CEO Says U.S. Rule Blocking Nvidia AI Chips Will Affect Next Year's Products — The Information AI
  5. Homelab builder runs Qwen 3.6 35B on three used Nvidia V100s at 100 tokens per second — DEV Community — Machine Learning
  6. Qwen4-Max Cuts AI Task Costs, but Gives Up Qwen’s Open-Model Edge — DEV Community — AI
  7. Alibaba's AI Computing Tied to Chinese Military Lab in Nvidia Chip Saga — New York Times Technology
  8. Alibaba co-founded military-linked AI lab, NYT reports — The Next Web

Read the Daily Brief: the day's most important AI stories →