I built a tiny transformer from scratch to invent dinosaur names. Would love feedback on the demo 🦖
Hey everyone! I built DinoGPT , a small PyTorch transformer that takes the beginning of a name and generates the rest, one letter at a time. It has about 53k parameters , trained on 1,535 dinosaur names . I wrote the attention mechanism myself to understand how transformers work and added a Streaml…
Read the full story at r/deeplearning ↗
Timeline · 2 reports
- 2026-10-24 04:42 · r/learnmachinelearning
I built a tiny transformer from scratch to invent dinosaur names. Would love feedback on the demo 🦖 - 2026-10-24 04:39 · r/deeplearning
I built a tiny transformer from scratch to invent dinosaur names. Would love feedback on the demo 🦖