I trained a 10M-parameter LM from scratch on a free Colab T4 in under 8 minutes — notebook, the real loss curve, and the two things that bit me
One notebook, free T4, nothing pretrained. 10.8M params, byte-level, 1.1 MB of tinyshakespeare, 2000 steps in 7m45s. No Trainer , no tokenizer download, no config files — the training loop is eight lines and you can read every one of them. https://colab.research.google.com/github/mira687/olm-colab-…
Read the full story at r/learnmachinelearning ↗
Timeline · 1 report
- 2026-09-23 13:00 · r/learnmachinelearning
I trained a 10M-parameter LM from scratch on a free Colab T4 in under 8 minutes — notebook, the real loss curve, and the two things that bit me