AINewsnow

Apple: 35B at 10 t/s tg for $300 hardware cost

This story is from 2026-08-30. It is preserved in the archive; the latest stories are on the live feed.

While everybody is wondering what performance Apple's latest and greatest hardware can deliver, I kept wondering why my trusty Mac Pro 6,1 has two GPUs. Well, for local inference, OBVIOUSLY. So here comes the floor in terms of hardware cost for running a reasonably sized model. But beware, this is…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-08-30 10:18 · r/LocalLLM
    Apple: 35B at 10 t/s tg for $300 hardware cost

More stories

  1. Meta's personal AI agent Muse climbs to No. 1 among free apps on Apple's US App Store, ahead of ChatGPT; Muse launched on September 8 (Georgia Hennessy/Business Insider) — Techmeme
  2. Week in review: OpenAI ships managed Agents API, Apple's new Siri reportedly runs on Gemini, and three vendors add agent spend controls — r/artificial
  3. Apple reportedly building server packed with M-series Ultra chips for AI — Ars Technica AI
  4. Apple Reference Images Explained: The iPhone 18 Pro’s Hardware Solution to AI Slop — CNET AI
  5. Apple M5 Ultra Scores Big GPU Gains in Leaked Geekbench Benchmark — r/LocalLLM
  6. Considering Purchasing a Studio M5 — r/LocalLLM
  7. How to Limit What Apple’s New Siri AI Can Access in iOS 27 — EFF Deeplinks
  8. Local LLM on iPhone 18 is impressive — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →