Why does Grounding DINO VRAM suddenly jump on random batches during inference? CUDA caching, fragmentation, or memory leak?
This story is from 2026-09-01. It is preserved in the archive; the latest stories are on the live feed.
I’m working on an image auto-annotation pipeline using Grounding DINO from Hugging Face with PyTorch, and I’m trying to understand some unusual GPU VRAM behavior during inference. My dataset contains 6 classes: cup glass plate knife fork spoon I downloaded the data from a Kaggle competition. The tr…
Read the full story at r/computervision ↗
Timeline · 2 reports
- 2026-09-01 11:40 · r/deeplearning
Why does Grounding DINO VRAM suddenly jump on random batches during inference? CUDA caching, fragmentation, or memory leak? - 2026-09-01 11:38 · r/computervision
Why does Grounding DINO VRAM suddenly jump on random batches during inference? CUDA caching, fragmentation, or memory leak?