AINewsnow

Mac and Qwen 3.8 27B users... are you using GGUF or MLX? I need 100K of context and 10-15 tps with Q4.

This story is from 2026-09-03. It is preserved in the archive; the latest stories are on the live feed.

Hi people. Someone recommended to me using gguf instead of mlx because mlx would consume too much memory on larger context. And to use llamacpp directly. I have 32gb of ram btw. What is your recommendation? I didn't get great results with LMStudio (limits my context too much) and was trying MTPLX b…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-09-03 13:38 · r/LocalLLM
    Mac and Qwen 3.8 27B users... are you using GGUF or MLX? I need 100K of context and 10-15 tps with Q4.

More stories

  1. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  2. Alibaba releases Qwen-Image-2.1, a 7B open-weight model it says outperforms most closed-source models, with native transparency and up to ten reference images (Qwen) — Techmeme
  3. Qwen Image 2.1 PR to ComfyUI — r/StableDiffusion
  4. Qwen q4 3.8 27b 16 tok/s 32k RTX 3060 :D — r/LocalLLM
  5. 10 hours left fo Qwen Image 2.1 Public Open Source Release — r/StableDiffusion
  6. Qwen 3.8 27B running on a single RTX 5090 researches and creates a full animation using only code. — r/artificial
  7. US government website used Chinese model the FBI called "malicious" — Ars Technica AI
  8. M2 Mac ultra128gb Qwen flash next — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →