AINewsnow

How can I speed up simple search results on my local LLM?

I'm using Qwen 3.8 on a miniPC (128GB Unified Memory) AMD Ryzen Max 395 processor. I'm not expecting super fast queries, but even something like "what's the score of X sports game" takes 5-7 minutes or "What's the metacritic score of X game" take 20+ minutes. I'm using DuckDuckGo web search plugin.…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-05 00:32 · r/LocalLLM
    How can I speed up simple search results on my local LLM?

More stories

  1. Strata is seriously impressive, running Qwen 3.8 Flash Next on hermes at 512k context. — r/LocalLLM
  2. Qwen3.8-Flash-Next 177B running at 11–15 tok/s on a single RTX 5070 12GB + 32GB RAM DDR4 — r/LocalLLaMA
  3. One .char model, Consistent face, body & cloths, now works in Comfy(Custom node & workflows) MinimaxH3 & Flux2 — r/comfyui
  4. llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) by ngxson · Pull Request #29818 · ggml-org/llama.cpp — r/LocalLLaMA
  5. My frontier class agent fact-checks my local AI before I grade it. How do you grade your Agents and LLMs? — r/AI_Agents
  6. Is all the work that's being put into Qwen3.8 Flash Next going to set us up for a very quick uplift to Qwen4? — r/LocalLLaMA
  7. ComfyUI Qwen image 2.1 Enhancer (Two nodes) — r/StableDiffusion
  8. I built Ninfer 4080 for 16GB class GPUs — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →