AINewsnow

M6 Mac Mini owners (32GB): now you can run Qwen3.8-27B in high quality on the Apple Neural Engine

ANEMLL Forge 0.2.1: Qwen3.8-27B on the M6 Neural Engine now runs up to 192K context (M6 32GB). New: INT8 K/V cache (half of FP16) and a smaller drafter sharing the target's output head — 0.86 GB less ANE memory, same speed. Decode depends on content: JSON 35–62 tok/s, code 18–32, prose 10–17. Prefi…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-24 21:04 · r/LocalLLM
    M6 Mac Mini owners (32GB): now you can run Qwen3.8-27B in high quality on the Apple Neural Engine

More stories

  1. Google CEO Sundar Pichai reveals how AI agents help him keep up with company updates — Mint AI
  2. The AI graveyard: a running list of projects and startups that didn't make it — TechCrunch AI
  3. I tested 8 local OCR readers on tax documents (thought would be useful sharing real results) — r/computervision
  4. The AI graveyard is a reproducibility audit, not a failure ledger — DEV Community — Machine Learning
  5. [Mac] Native Minimax H3 on Silicon in ComfyUI — r/comfyui
  6. Codex Computer Use fails to capture Safari on Mac mini M4 (-3811 / -3812) — r/OpenAI
  7. NVIDIA's Dory 1.0 4B (looped reasoning model) on Apple Silicon with MLX: 101 tok/s at 1 loop, 69 at 2, on an M5 Max (4.2 GB 8-bit build) — r/LocalLLM
  8. Benchmark: Recursive's Flint 40B A2.5B Q4 achieves 128 tok/s on MacBook Pro M4 Pro 48GB using Kapitsa, an open-source Apple Silicon optimized engine, Claude/Codex/Pi/OpenCode compatible. — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →