Homelab builder runs Qwen 3.6 35B on three used Nvidia V100s at 100 tokens per second
A $1,042 homelab rig using three decommissioned Nvidia Tesla V100 GPUs serves Qwen 3.6 35B at about 100 tokens per second, outpacing a $5,399 M5 Max Mac Studio at long contexts.
Read the full story at DEV Community — Machine Learning ↗
Timeline · 3 reports
- 2026-11-19 11:00 · Tom's Hardware
Three 'e-waste' Nvidia V100s hit 100 tokens per second on Qwen 3.6 35B in a $1,042 homelab rig — decommissioned GPUs outpace a $5,399 M5 Max Mac Studio at long contexts - 2026-11-19 11:00 · Tom's Hardware
Three 'e-waste' Nvidia V100s hit 100 tokens per second on Qwen 3.6 35B in a $1,042 homelab rig - 2026-11-18 21:35 · DEV Community — Machine Learning
How many tokens per second should an LLM serve on one GPU?