Four Bedrock request-level settings drive inference cost differences
An AWS Machine Learning Blog post outlines four request-level choices on Amazon Bedrock — cache duration, service tier, reasoning effort, and maxTokens — that change inference costs even after prompt and application tuning.
Read the full story at AWS Machine Learning Blog ↗
Timeline · 1 report
- 2026-11-12 20:51 · AWS Machine Learning Blog
Four Amazon Bedrock inference choices that affect cost