Same price per token, 2.7x the bill: what I learned trying to forecast my LLM API costs
TL;DR: Two models with the same $0.10 / $0.50 price cost $122 vs $330 on the same tests. Claude’s prompt cache costs more than no cache at all if your requests come more than 5 minutes apart. And one of the cheapest DeepSeek hosts per token costs more than twice as much per task as DeepSeek’s own A…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-22 09:12 · r/LocalLLM
Same price per token, 2.7x the bill: what I learned trying to forecast my LLM API costs