Bought a refurbished RTX 2080 Super (~$190) just to babysit my desktop, so my 5090 does nothing but LLM.
While benchmarking I noticed decode at ~120K context depends on what Chrome is doing: Chrome open and visible: 51 tok/s Chrome minimized: 59 tok/s Chrome closed: 64 tok/s Short prompts barely notice. My guess: on Windows (WDDM) with a 4K 240 Hz monitor on the same GPU, every compositor/Chrome repai…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-27 11:29 · r/LocalLLM
Bought a refurbished RTX 2080 Super (~$190) just to babysit my desktop, so my 5090 does nothing but LLM.