AINewsnow

My gateway looked fine for 3 days. Then one request took 92 seconds.

This story is from 2026-09-03. It is preserved in the archive; the latest stories are on the live feed.

I run an OpenAI-compatible gateway. Every day I fire the same request at it three times and write down how long each one took. Tiny request, max_tokens=10 , nothing clever. Here's the last four days: When #1 #2 #3 Aug 31 morning 2.42s 11.22s 92s (timeout) Aug 31 evening 2.07s 2.30s 1.77s Sep 1 1.64…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-09-03 07:11 · DEV Community — AI
    My gateway looked fine for 3 days. Then one request took 92 seconds.

More stories

  1. Gemini Hacked Three Companies in First Known Breakout by Google’s AI — Wall Street Journal Technology
  2. OpenAI reveals new cases of AI models cheating, going off script — Washington Post AI
  3. Introducing Astra for Law — OpenAI News
  4. Novo Nordisk Will Use Anthropic’s Claude for Drug Research — Wall Street Journal Technology
  5. OpenAI discloses six new safety incidents — Axios AI+
  6. ‘Jailbreak-like...’: AI's ‘unexpected’ behaviour mounts concerns, OpenAI's 'rogue agents probed' Hugging Face — Mint AI
  7. Our framework for reporting model misalignment — OpenAI News
  8. Microsoft exec called AI scraping the “largest theft of labor in human history” — Ars Technica AI

Get the daily brief of stories like this at 6:30 every morning →