Built a VRAM scheduler (vramble) to automate model swapping on my local AI workstation
I set up a dedicated workstation for local AI experimentation with various models and tools. But every single one of them wants all the available VRAM. To fix this, I built a request dispatching layer called vramble . It automatically loads and unloads models and manages the queue using a priority…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-13 05:28 · r/LocalLLaMA
Built a VRAM scheduler (vramble) to automate model swapping on my local AI workstation