AWS adds explicit prompt caching for open-weight models on Amazon Bedrock
This story is from 2026-11-16. It is preserved in the archive; the latest stories are on the live feed.
AWS introduced explicit prompt caching for open-weight models on Amazon Bedrock, letting applications reuse repeated long context across requests to cut input costs and latency, with implementation guidance published.
Read the full story at AWS Machine Learning Blog ↗
Timeline · 2 reports
- 2026-11-16 15:42 · AWS Machine Learning Blog
Use prompt caching with open-weight models on Amazon Bedrock - 2026-11-16 15:42 · AWS Machine Learning Blog
Introducing explicit prompt caching with open-weight models on Amazon Bedrock