Don't trust frontier models when asking about budget hardware!
Early this year when I was first looking at building up my inference capability you could get the 16GB Tesla P100s for between $60 and $80. Asked claude about it, told me absolutely not worth it. No tensor cores, bad int4/int8, no BF16, not worth it. Needs special power accommodations, Above 4G dec…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-27 18:21 · r/LocalLLaMA
Don't trust frontier models when asking about budget hardware!