h100 was 15% faster than my 4070 for qlora, not the 4-5x i expected
I’ve got a 4070 at home that I was using to fine-tune a 7B model on a custom dataset. A full QLoRA run took around 11 hours and I was running it 3-4 times a week. Figured I should just rent an H100 for a couple of weeks and be done faster. The H100 was clearly running the actual compute faster. GPU…
Read the full story at r/deeplearning ↗
Timeline · 1 report
- 2026-10-14 03:48 · r/deeplearning
h100 was 15% faster than my 4070 for qlora, not the 4-5x i expected