AINewsnow

PolyGraph: Plan-Buffered CUDA Graphs for Adaptive Speculative Decoding

arXiv:2610.23861v1 Announce Type: new Abstract: Adaptive speculative decoding changes the active batch size B and draft length d from one decode step to the next, whereas a CUDA Graph replays a fixed launch configuration. The resulting verification width M = B d forces serving systems to pre-captur…

Read the full story at arXiv cs.LG ↗

Timeline · 1 report

  1. 2026-10-20 04:00 · arXiv cs.LG
    PolyGraph: Plan-Buffered CUDA Graphs for Adaptive Speculative Decoding

More stories

  1. Inception launches Mercury 3, a diffusion LLM it claims tops GPT-6 Luna, Claude Haiku 5.5, and GLM-5.3 Flash on agentic benchmarks while being 4x to 8x faster — Techmeme
  2. MiniMax launches M3.1 Flash, confirming Space Bunny was an early build — Vercel Blog
  3. OpenAI Staffer Charged With Bugging Office Stays Jailed for Now — Bloomberg AI
  4. Spain-Based Startups Advance Regional Innovation With Barcelona Supercomputing Center — NVIDIA Blog
  5. Introducing Clairic, a new System One class of extraction models — Cloudflare Blog — AI
  6. Nscale and Anthropic are reportedly in talks for yet another $45B compute deal — TechCrunch AI
  7. US bans DeepSeek AI from government use as tech tension with China continues — BBC Technology
  8. How HP Is Building an AI-Ready CDP with Databricks CustomerLake — Databricks Blog

Get the daily brief of stories like this at 6:30 every morning →