Serving Iris-3B Turbo: the 42 GB repo, the 21 GB of VRAM and the 8 MB payload limit
A "3B" image model sounds like something you can drop on any spare GPU. Iris-3B Turbo, from Sperid Labs, unteaches that. We wrapped it in a custom backend (the code that loads a model once and then answers requests) behind an endpoint that accepts OpenAI's image API JSON. The model behaved. What bi…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-19 12:45 · DEV Community — Machine Learning
Serving Iris-3B Turbo: the 42 GB repo, the 21 GB of VRAM and the 8 MB payload limit