Why does a small local LLM repeat itself when you ask it for 100 rows of JSON?

Asking a language model for synthetic training data usually means one prompt: "Generate N rows as a JSON array", a schema, a few example rows. With a 3B model running on a laptop, that works at 20 rows and starts to fall apart at 40, in a very specific way: the model starts copying its own earlier…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

1. 2026-11-09 06:03 · DEV Community — Machine Learning
   Why does a small local LLM repeat itself when you ask it for 100 rows of JSON?