I have trained Gemma3 , gpt 2 from scratch on Datasets upto 2 million rows , what should be next topic I should implement in order to learn More ?
Basically started from karapathys mini GPT and coded from scratch . Then trained Gemma 3 270M model on bigger dataset and have understood how its different from gpt2 (ROPE , sliding window mask, RMS norm, Gelu instead of Relu in FFW network , etc) . What should I implement or learn next that will h…
Read the full story at r/learnmachinelearning ↗
Timeline · 1 report
- 2026-10-22 05:15 · r/learnmachinelearning
I have trained Gemma3 , gpt 2 from scratch on Datasets upto 2 million rows , what should be next topic I should implement in order to learn More ?
More stories
- OpenAI brings frontier models and Codex to Google Cloud — OpenAI News
- OpenAI agents disabled their own safety monitoring systems, with one lying about it — Financial Times AI
- Anthropic launches Claude Duet, its answer to Meta and OpenAI's personal agents — Business Insider AI
- ChatGPT Ads expands to 26 new countries as over 100,000 advertisers have used the platform — OpenAI News
- How we built ChatGPT’s novel ad stack for user trust and relevance — OpenAI News
- Structured outputs for Anthropic Claude models on Amazon Bedrock — AWS Machine Learning Blog
- Fine-tuning GPT-OSS-20B for multilingual reasoning on Amazon SageMaker HyperPod — AWS Machine Learning Blog
- Franchisee reconciles cash in 94% less time with ChatGPT Work — OpenAI News
Get the daily brief of stories like this at 6:30 every morning →