Lessons learned while building Apex-2
Hi everyone, thank you so much for all the interest in my model. It's more than I expected. Here is a short summary of the trial and error I went through while building Apex-2. 1. GPUs were always the bottleneck I planned to train on about 1T tokens, but in the end I could only train on about 80B.…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-05 08:18 · r/LocalLLaMA
Lessons learned while building Apex-2