Constrained Decoding: Your JSON Schema Key Order Is a Prompt
I flipped one support-ticket classifier from free text to a strict JSON Schema and accuracy fell off a cliff. Same model. Same temperature. Same prompt. Same 300 tickets in my eval set. The only thing that changed was that the output now parsed 100% of the time. That guarantee comes from constraine…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-09-21 17:16 · DEV Community — Machine Learning
Constrained Decoding: Your JSON Schema Key Order Is a Prompt