AINewsnow

What are some tricks to get Qwen 3.8 27B to run faster?

This story is from 2026-10-03. It is preserved in the archive; the latest stories are on the live feed.

I have it running on an RTX 3090, 64K context, q5, xhigh reasoning, just as an always on personal assistant - reading emails, calendar, updating google docs/sheets, memory files, etc. The harness is vercel's eve framework, with a few patches. While the quality is pretty great, for 'live' chatting/t…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-03 05:47 · r/LocalLLM
    What are some tricks to get Qwen 3.8 27B to run faster?

More stories

  1. Don't let the model do date math: a refund-agent test where Gemini 4 Carbon broke a 30-day rule and Qwen 4 Max held it — DEV Community — AI
  2. How to Speed Up Qwen3.8-27B in llama.cpp (NVIDIA's Draft Model May Lose to MTP) — DEV Community — Machine Learning
  3. Qwen4-Max Cuts AI Task Costs, but Gives Up Qwen’s Open-Model Edge — DEV Community — AI
  4. RadixArk opens DaisyRose-27B, an agent-tuned Qwen model — DEV Community — AI
  5. Run Mobilerun with local and cheap models Ollama, DeepSeek, Qwen, OpenRouter — DEV Community — Machine Learning
  6. An attached file told the model to delete all customers. In OpenWebUI, it tried — DEV Community — AI
  7. RadixArk Doubles A Free AI Model's Coding Score In Just 18 Days — DEV Community — Machine Learning
  8. How to deploy an AI agent using Google ADK in Agent Runtime and register it in Gemini Enterprise — DEV Community — AI

Read the Daily Brief: the day's most important AI stories →