How much does it cost to fine-tune a 70B model?
Fine-tuning a 70B model costs roughly $1 to $2 of GPU time per million training tokens, or about $20 for a 20-million-token LoRA run. On Nodus the cheapest setup per token is LoRA on one B200, listed at $5.50/hr, even though one A100 80 GB is a fifth of that hourly price. Treat these as planning nu…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-05 21:51 · DEV Community — Machine Learning
How much does it cost to fine-tune a 70B model?