AINewsnow

When Is a KV Cache Slot Actually Free? Lessons From the SGLang and Cloudflare Cross-Request Exposure

TL;DR What was reported: On 2026-10-26, Cloudflare and the SGLang team disclosed that Cloudflare's GLM-5.3 deployment on Workers AI returned 155 responses containing data from other customers' requests between 2026-08-27 and 2026-09-09. Cloudflare says all 155 were answers to prompts longer than 68…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-01 14:07 · DEV Community — Machine Learning
    When Is a KV Cache Slot Actually Free? Lessons From the SGLang and Cloudflare Cross-Request Exposure

More stories

  1. 4 Strix Halo boxes! Finally joined local AI — r/LocalLLM
  2. Why Cloudflare's GLM-5.3 KV Cache Leaked Across Tenants — DEV Community — AI
  3. How a GPU Memory Mismatch Let Cloudflare's AI Serve One Customer Another's Data — DEV Community — AI
  4. UkisAI Swift GLM5.3 + GSQ-RCO, Swift Ornith 9B / -57.7% Token Usage with <1% accuracy loss on max reasoning — r/LocalLLaMA
  5. Z.ai founder says self-improving AI key step towards AGI but must be done safely — South China Morning Post Tech
  6. China's AI Labs Pursue Recursive Self-Improvement Without Altering Model Weights — Pandaily
  7. ByteDance's Doubao Work Adds Kimi, GLM and DeepSeek Models for Team and Enterprise Plans — Pandaily
  8. Anthropic files for blockbuster IPO as Blackstone flags likely junk rating — New York Times Technology

Get the daily brief of stories like this at 6:30 every morning →