AINewsnow

What are some tricks to get Qwen 3.8 27B to run faster?

I have it running on an RTX 3090, 64K context, q5, xhigh reasoning, just as an always on personal assistant - reading emails, calendar, updating google docs/sheets, memory files, etc. The harness is vercel's eve framework, with a few patches. While the quality is pretty great, for 'live' chatting/t…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-03 05:47 · r/LocalLLM
    What are some tricks to get Qwen 3.8 27B to run faster?

More stories

  1. China's AI stack is collapsing search, commerce and payments into one loop — r/ArtificialInteligence
  2. Gemma 5 - what to expect — r/LocalLLM
  3. Viggle turbo v0.3 for Qwen image 2.1: less grain and cleaner surfaces — r/StableDiffusion
  4. Qwen 3.8 Flash Next - doubled Strata throughput on 3090+5070 Ti, IQ3_S 2466 pp/167 tps, UD-Q4_K_XL 2341 pp / 126 tps (yes, really) — r/LocalLLM
  5. add GLM-5.3-Flash (GLM5-Next) support (#27773) · ggml-org/llama.cpp@649dcb1 — r/LocalLLaMA
  6. Pi extension: Skip reasoning with local Qwen 27B and proceed to answer right now — r/LocalLLaMA
  7. Direct weight surgery from Qwen-4B to 0.8B on an 8GB RX 580: why editing all layers breaks everything, and how 4 anchor blocks fixed it — r/machinelearningnews
  8. I made my iPhone a second GPU for my 24 GB MacBook: Qwen 3.8 27B prefills 29–44% faster & my holds part of the CTX window. — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →