AINewsnow

Why is my local AI slow to respond (first and subsequent interactions)?

I have ollama and openwebUI setup in an LXC on my proxmox server (96 cores, 256 GB RAM) with 3 Nvidia A4000 GPUs passed through to the LXC. However my local AI runs pretty slow. Slow on the first interaction and slow on subsequent interactions. I've tried large models such as Qwen3.8:27b and smalle…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-26 03:12 · r/LocalLLM
    Why is my local AI slow to respond (first and subsequent interactions)?

More stories

  1. Maya-XS runs DeepSeek-V4.1-Flash in 120.6 GB, with all 384 experts resident in GPU memory on a 128 GB Ryzen AI Max. — r/LocalLLaMA
  2. NVIDIA releases Nemotron 3.5 Bolt E4B - Runs locally on 6GB RAM. — r/LocalLLM
  3. Scaling NVIDIA TensorRT Performance Optimization Beyond a Single Build Route with the Global Performance Tuner, Part 1 — NVIDIA Technical Blog
  4. Post-Training at the Frontier — CoreWeave Blog
  5. Parakeet v3 vs Whisper vs Apple's on-device model in 25 languages, every transcript published — DEV Community — Machine Learning
  6. SWI Compute Debuts With Plans for NVIDIA AI Factories Across Europe — Unite.AI
  7. The morality of maintaining locks on older hardware — r/LocalLLM
  8. DSpark on an RX 7900 GRE: Qwen3-8B goes from 59 to 133 tok/s in llama.cpp — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →