Single RTX 3090 running a local agent + image/video gen: real-world numbers from daily use
This story is from 2026-11-16. It is preserved in the archive; the latest stories are on the live feed.
TL;DR: One RTX 3090 runs a 27B LLM agent (a Discord bot) and ComfyUI image/video generation by swapping models in and out of VRAM. I get ~72 tok/s on Qwen3.8 27B at 64k context, SDXL images in ~32 s, and 10-second Wan 2.2 videos in 4–6 minutes. All numbers come from real daily use, not synthetic be…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-11-16 18:24 · r/LocalLLM
Single RTX 3090 running a local agent + image/video gen: real-world numbers from daily use