50 UUIDs made my LLM call 4.8x more expensive than the numbers 1 to 50
You have a list of products from your database and want the model to pick the ones that match a user's query. The obvious move is to paste the rows as they are, with their real IDs, and ask the model to return the IDs of the matches. It works on the first try, and that's why nobody looks at it agai…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-09 12:00 · DEV Community — AI
50 UUIDs made my LLM call 4.8x more expensive than the numbers 1 to 50