MiniMax M3 Prompt Caching on SambaCloud: How It Works
Prompt caching, first introduced on SambaCloud with MiniMax M2.7 , is now available for MiniMax M3. When requests share a stable prefix of at least 4,096 tokens, SambaCloud can serve that prefix from cache instead of recomputing it, with no code changes required. Cached tokens are billed at 90% bel…
Read the full story at SambaNova Blog ↗
Timeline · 1 report
- 2026-10-07 16:56 · SambaNova Blog
MiniMax M3 Prompt Caching on SambaCloud: How It Works