Priced per TB/s, the H200 beats the H100 at 6 of 7 providers
An H200 has exactly as much compute as an SXM H100 and usually rents for more, so on a FLOPS spreadsheet it never makes sense. The H200 vs H100 cost per token question turns on a different column: the H200 moves 4.8 TB/s out of memory against the H100's 3.35, and decode spends its time waiting on m…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-02 17:39 · DEV Community — AI
Priced per TB/s, the H200 beats the H100 at 6 of 7 providers