AINewsnow

Apple Neural Engine Reverse-Engineered for Qwen 3.8 27B Inference

This story is from 2026-08-21. It is preserved in the archive; the latest stories are on the live feed.

A developer reverse-engineered Apple's Neural Engine to run Qwen 3.8 27B FP16 at 7-8 tok/s using 7W, while Mac users report 17-20 tok/s via LM Studio and RTX Pro 4000 SFF Blackwell users seek speed benchmarks.

Read the full story at r/LocalLLM ↗

Timeline · 3 reports

  1. 2026-08-22 12:16 · r/LocalLLM
    Any of you running Qwen 3.8 27B on an RTX Pro 4000 SFF Blackwell?
  2. 2026-08-22 04:48 · r/LocalLLM
    people running Qwen 3.8 27B on apple silicon… whats your best token generation speed and how did you attain it?
  3. 2026-08-21 12:02 · r/LocalLLM
    Running Qwen 3.8 27b FP16 on the Apple Neural Engine - 7 Watts of power to run a FP16 model @ 7 tok/s

More stories

  1. Runway News | Runway Dev is in Claude Code, Codex and Cursor — Runway Research
  2. Apple cuts engineers' daily AI spending caps in broader cost-control push — Bloomberg AI
  3. Apple opens AI beta in China with Qwen-integrated Siri — DigiTimes Asia
  4. Apple opens Siri AI Developer Preview to all developers in iOS 27.3 beta — Engadget
  5. GitHub Copilot expands to JetBrains Air and Apple's Xcode coding assistant — GitHub Copilot changelog
  6. Apple to require 18+ age ratings for dating apps and AI romantic companions — TechCrunch AI
  7. Apple flags risks of rogue AI agents in annual SEC filing — CNBC Technology
  8. Apple's AI Safe-Haven Status Shows Cracks as Investors Weigh Its Low AI Exposure — Wall Street Journal Technology

Get the daily brief of stories like this at 6:30 every morning →