AINewsnow

Coding with local LLM is quit slow on a M5 Pro?

Hi, got my new Macbook Pro with an M5 Pro 20c and 48GB RAM from work. I ran Qwen 3.8 27B 4 Bit with oMLX. I asked it to write Python script with the dlt framework to get Jira Cloud API data and save it into a Postgres DB table. That took 18 minutes. I think it would have been faster to write that b…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-09-30 20:05 · r/LocalLLM
    Coding with local LLM is quit slow on a M5 Pro?

More stories

  1. If you are running Qwen 3.8 Flash Next on Strix Halo, use this software for inference. It's so much faster than llama.cpp especially at high context. — r/LocalLLaMA
  2. Two open-weights releases: Victoria (Qwen3.8-Flash-Next with 44% of experts cut, 70% Terminal-Bench 2.1, GGUF included) and Maple (a Canada-first fine-tune) — r/LocalLLM
  3. Layer Extract & Layer Remove Loras For Qwen Image 2.1 — r/StableDiffusion
  4. I tested Qwen Image 2.1, FLUX Klein 2, Krea 2, and Z Image in ComfyUI using the same prompts. Some interesting differences came out 👀 Full comparison here if you want to check it out! — r/comfyui
  5. What model sits between Qwen 3.8 27b and Flash next for coding? — r/LocalLLaMA
  6. vulkan: fuse qwen4exp's SCALE -> SIGMOID -> SCALE -> hc_post chain by fxgsell · Pull Request #29520 · ggml-org/llama.cpp — r/LocalLLaMA
  7. Qwen-family LLMs are quietly becoming the backbone of modern audio models; One chart for the architectures of 100+ audio models — r/LocalLLaMA
  8. Best Open source TTS models to run locally, I´ve been using Qwen tts 1.7b. Is there something small and better? — r/comfyui

Get the daily brief of stories like this at 6:30 every morning →