AINewsnow

Qwen 3.8 27B Q4_K_M running on a OnePlus 13 with 24 GB RAM

The power of 27B parameters, in the palm of my hand 😄 If anyone’s interested, these are the results I got on my OnePlus 13 with 24 GB RAM using llama.cpp . Qwen 3.8 27B Q4_K_M 16K context around 21.2 GB of memory about 2.5 tok/s Normally I run Qwen 3.5 9B together with always-on ASR + TTS. It gets…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-12 15:09 · r/LocalLLM
    Qwen 3.8 27B Q4_K_M running on a OnePlus 13 with 24 GB RAM

More stories

  1. Qwen3.8-27B on a single 3090: 140 tok/s on code with a custom megakernel — r/LocalLLaMA
  2. Qwen 3.6 35B A3B: 131K context + vision on 6GB VRAM — r/LocalLLaMA
  3. downloaded Qwen3.8-27B-GSQ-RCO-IQ3_S but cant see it in llama.cpp's web ui, why?? — r/LocalLLM
  4. Qwen Image 2.1 Turbo and MiniMax H3 Gain Community Support — r/StableDiffusion
  5. Run a local coding agent with Ollama + Qwen 3 using OpenPilot — DEV Community — AI
  6. Hacking OpenAI or Anthropic — r/LocalLLM
  7. I clustered two old Android phones to run a 27B LLM locally. Bypassed RAM limits via C++ RPC split and Hadamard Ternary math (No overheating) — r/LocalLLM
  8. Qwen3.8-Flash-Next (125B) at ~100 tok/s on an M5 Ultra Mac Studio with llama.cpp — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →