Why my from-scratch Japanese LLM says "That sounds tough" to good news
This story is from 2026-10-08. It is preserved in the archive; the latest stories are on the live feed.
TL;DR Lilas is a ~40M-parameter Japanese chat model I built from scratch, tokenizer included. It kept answering cheerful remarks with "That sounds tough, please don't overdo it." A raw count of the training data pointed at one over-used phrase. Weighting the counts by how the data is actually mixed…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-08 16:12 · DEV Community — Machine Learning
Why my from-scratch Japanese LLM says "That sounds tough" to good news