Overfitting and creativity
I remember great creativity from GPT-2. It was trained on a dataset that is orders smaller than current training datasets. The problem with overfitting a model to the training data is that it becomes unable to generalise; it is very good to predict the test set, but on fresh data its predictions ar…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-15 10:52 · r/LocalLLaMA
Overfitting and creativity