pre-training nanochat with 2x RTX Pro 4000
I recently got 2x RTX Pro 4000 blackwells for my home setup. I was curious how fast it would run nanochat. The problem is the target hardware: 8x H100 gpus. Nanochat pre-trained ClimbMix to GPT-2 level with 8xH100 GPUs in 1hr 39 mins. I ended up tuning nanochat for my 2x RTX Pro 4000 gpus. Because…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-14 00:08 · r/LocalLLM
pre-training nanochat with 2x RTX Pro 4000