Same Template, Different Request: Fingerprint What You Actually Send to the Model
An eval run drifts. You check the usual suspects: the model ID is pinned, the dataset hash matches, and the prompt template hasn't changed since last week's commit. Everything you recorded says the two runs were identical. They weren't. The gap is usually between what you versioned and what you sen…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-11 13:46 · DEV Community — AI
Same Template, Different Request: Fingerprint What You Actually Send to the Model