AINewsnow

Update: MAFDET now runs on Apple Silicon. Qwen3-14B answers in 12 s instead of 33 on an M2 Pro

A few days ago I posted MAFDET here ( https://www.reddit.com/r/LocalLLM/s/LqHp8X306f ): a local app (llama.cpp underneath) that starts reasoning about your message while you're still typing, so most of the thinking is done before Enter. It now runs on Apple Silicon Macs , on the GPU through Metal.…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-26 15:48 · r/LocalLLM
    Update: MAFDET now runs on Apple Silicon. Qwen3-14B answers in 12 s instead of 33 on an M2 Pro

More stories

  1. Drex 2.0 now runs completely local on Apple Silicon. Open weights. Sub-200ms latency. Zero cloud dependencies.• Footprint: 21 GB (4-bit Q4_K_M)• Hardware: 36 GB+ Unified Memory (Apple Silicon)Median decision latency (M5 Pro):• Kapitsa: 113 ms • llama.cpp: 248 ms • Ollama: 282 ms — r/huggingface
  2. ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO — r/LocalLLaMA
  3. 8 GB GPU, 262K context 3.5 BPW Qwen-Flash-Next Coder 70 T/s using llama.cpp — r/LocalLLaMA
  4. Qwen3.8-27B Q6 on one RTX 5090: 69 → 100 tok/s short, 35 → 64 tok/s at 120K context, just by leaving LM Studio for a native llama.cpp build (full benchmarks + recipe) — r/LocalLLM
  5. I created a benchmark to test local LLMs on your Snapdragon NPU (open source) — r/LocalLLM
  6. boro64/Ternary-Nemotron-3.5-Lightning-30B-A3B-GGUF · Hugging Face — r/LocalLLaMA
  7. I built my first RAG project using Whisper, BGE-M3 and Ollama — what should I improve? — r/learnmachinelearning
  8. Gemma 4 26B-A4B on a 16 GB Mac: 33/40 on TypeScript tasks, 31 tok/s, offline, using Google's stock file — r/huggingface

Get the daily brief of stories like this at 6:30 every morning →