GPT-6 Prompt Caching Makes Latency and Cost an Engineering Choice
TL;DR OpenAI announced improved prompt caching for GPT-6 on September 22, 2026: higher cache hit rates by default, plus a dashboard, a diagnostics tool, explicit breakpoints, and prewarming. Cached input tokens are discounted up to 90% for eligible shared prefixes reused within a 30-minute window.…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-10 14:00 · DEV Community — AI
GPT-6 Prompt Caching Makes Latency and Cost an Engineering Choice