Route each prompt to the right model, with a decision model in your cluster and one agentgateway policy
This story is from 2026-10-01. It is preserved in the archive; the latest stories are on the live feed.
A hands-on lab, every file included. A 170-line ExtProc asks a decision model which tier should answer, and agentgateway routes on the reply. Runs on kind, on a CPU, and the prompts stay home. Every platform team I talk to lands in the same meeting sooner or later. The agents send everything to the…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-01 06:30 · DEV Community — AI
Route each prompt to the right model, with a decision model in your cluster and one agentgateway policy