Tracing where LLM "slop" style comes from in the model and in training, and cutting it out [R]
I wanted to find where the recognizable assistant style (em dashes, "it's not X, it's Y", lists of three, buzzwords) lives in a model and which training stage installs it. Where it lives: in Qwen3-4B-Instruct, a difference-in-means direction from the model's own exaggerated vs plain writing separat…
Read the full story at r/MachineLearning ↗
Timeline · 1 report
- 2026-10-14 22:08 · r/MachineLearning
Tracing where LLM "slop" style comes from in the model and in training, and cutting it out [R]