I ran the same QLoRA 7B job 8 times on Vast.ai RTX 4090s. The bill went from $0.19 to $0.81. Here is what moved it.
When people compare a rented RTX 4090 with a cloud A100, they multiply the hourly GPU price by the training time. I wanted to see what actually shows up on the Vast.ai invoice for one fixed job on different hosts. The job: Qwen2.5-7B-Instruct, 4-bit QLoRA, yahma/alpaca-cleaned , 300 steps, checkpoi…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-12 19:06 · DEV Community — Machine Learning
I ran the same QLoRA 7B job 8 times on Vast.ai RTX 4090s. The bill went from $0.19 to $0.81. Here is what moved it.