AINewsnow

Ollama: a keep_alive on the loaded model cancels the swap another request waits for

This story is from 2026-10-22. It is preserved in the archive; the latest stories are on the live feed.

TL;DR : With OLLAMA_MAX_LOADED_MODELS=1 , a request for a model that isn't loaded makes Ollama schedule the loaded model to unload as soon as it's idle, and the request waits. If a request for the loaded model arrives during that wait and carries keep_alive , that value replaces the pending unload:…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-22 05:49 · DEV Community — AI
    Ollama: a keep_alive on the loaded model cancels the swap another request waits for

More stories

  1. OpenAI brings frontier models and Codex to Google Cloud — OpenAI News
  2. Recursive Releases Flint, an Open-Weight 40B MoE Local Coding Model for Agents with 2.5B Active Params — MarkTechPost
  3. Meta to create a new class of shares to fund AI push — The Verge AI
  4. NVIDIA Cosmos Opens New Tools to Train, Evaluate and Deploy World Models — NVIDIA Blog
  5. How Companies Are Using NVIDIA DSX to Break the Power Bottleneck — NVIDIA Blog
  6. Websites pulled offline worldwide as AI finds critical security flaws — South China Morning Post Tech
  7. Need a little Bit of Help — r/learnmachinelearning
  8. Solving a 31-year-old grand challenge in mathematics – the KLS conjecture — Microsoft Research Blog

Get the daily brief of stories like this at 6:30 every morning →