Developing intuition for model behavior, architecture choices, and convergence?
Hi everyone, this is my first post so m kind of nervous ๐ , I recently built a Transformer from scratch and trained it for English-to-French translation,trying to recreate Attention Is All You Need with a 30M and 60M model. The 60M model has less data diversity.(wmt dataset) Even though I can see tโฆ
Read the full story at r/deeplearning โ
Timeline ยท 2 reports
- 2026-10-28 18:06 ยท r/learnmachinelearning
Developing intuition for model behavior, architecture choices, and convergence? - 2026-10-28 17:34 ยท r/deeplearning
Developing intuition for model behavior, architecture choices, and convergence?