The same H100 hour cost $1.26 or $0.22 per million tokens
This story is from 2026-10-13. It is preserved in the archive; the latest stories are on the live feed.
A GPU hour has one price. What it delivers does not. Here is one measurement that shows how big the gap can be. The setup. One rented H100 SXM 80GB on vast.ai at $2.689 per hour, 20 vCPUs. vLLM 0.27.1 (official image). Qwen2.5-0.5B-Instruct in fp16, unique prompts so nothing was cached. 28 Septembe…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-13 00:46 · DEV Community — AI
The same H100 hour cost $1.26 or $0.22 per million tokens