AINewsnow

For those of you running both ComfyUI and local LLMs, how are you managing GPU resources?

I’m curious how people here switch between ComfyUI workflows and local LLM inference, especially on a single GPU. Are you manually unloading models, using something like LM Studio or llama-swap, relying on ComfyUI’s model management, or have you built something to handle switching automatically? I’…

Read the full story at r/StableDiffusion ↗

Timeline · 1 report

  1. 2026-11-02 03:47 · r/StableDiffusion
    For those of you running both ComfyUI and local LLMs, how are you managing GPU resources?

More stories

  1. LFM3-1.7b seems impressive — r/LocalLLaMA
  2. 769 tok/s on a Single RTX 4090: Spark-X2.6-1.7B DSpark — DEV Community — Machine Learning
  3. Halving the KV Cache Doubles Capacity and Buys 1% of Speed — DEV Community — Machine Learning
  4. Are bespoke inference engines overhyped? My Strata experience on 2× R9700 — r/LocalLLaMA
  5. How we fit a 27B model on a 12 GB laptop GPU — DEV Community — Machine Learning
  6. Qwen3.6-35B-A3B on a laptop RTX 5050 8GB: ~1000 tok/s prefill and ~40-46 tok/s decode (config + steps) — r/LocalLLM
  7. Run a 35B to 180B LLM Without a GPU: VIDRAFT POCKET Passes 3.15 Million Downloads — DEV Community — Machine Learning
  8. How to Run LFM3-Omni-2B GGUF Locally (Only llama.cpp Makes It Talk Back) — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →