Is the Tesla V100 still a valid card for a local inference host?
I'm currently running my inference on my gaming PC on a 7900xtx. The box is to small to expand the rig. Also I rather want to have a second box. I'm planning to set up a dedicated inference host. I would like to have at leat 32GB VRAM, 40tps generation (+-5) and 1k+ pp. The v100 is used available h…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-07 21:51 · r/LocalLLM
Is the Tesla V100 still a valid card for a local inference host?