I Split the Wait. The Wire Ate P99.
This story is from 2026-09-19. It is preserved in the archive; the latest stories are on the live feed.
The generate call was not the slow part. The wait around it was. I stopped saying the model felt slow. That sentence is a shrug. It hides DNS, TLS, queueing, and decode together. You ever stare at a spinner and blame tokens? I did, for too long. Then I split the wait into clocks I could name. P99 j…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-09-19 09:32 · DEV Community — AI
I Split the Wait. The Wire Ate P99.