π **Built my own Local Language Model from scratch!**
Finally trained my own LM from randomly initialized weights β no pretrained model. π **Current metrics:** - Parameters: 2.95M - Training data: 279,586 German sentences - Training tokens: ~2.3M - Vocabulary: 8,192 tokens - Q&A dataset: ~7,200 examples It generates German text, but conversational reβ¦
Read the full story at r/learnmachinelearning β
Timeline Β· 2 reports
- 2026-10-12 12:19 Β· r/deeplearning
π **Built my own Local Language Model from scratch!** - 2026-10-12 12:17 Β· r/learnmachinelearning
π **Built my own Local Language Model from scratch!**