Cohere's Open-Source Megakernel Beats vLLM by 1.58x on H100

This story is from 2026-09-08. It is preserved in the archive; the latest stories are on the live feed.

Cohere open-sourced a serving engine that runs the entire LLM decode step as one persistent CUDA kernel, hitting 1.58x vLLM throughput on H100.

Read the full story at AlphaSignal ↗

Timeline · 1 report

2026-09-08 19:44 · AlphaSignal
Cohere's Open-Source Megakernel Beats vLLM by 1.58x on H100

More stories

The "Regulatory Moat" Hype Frontier Labs are Pushing is Shit — r/ArtificialInteligence
Cohere and Aleph Alpha agree to merge in reported $20B deal — SiliconANGLE AI
We're paying OpenAI, Cohere and Textract separately just to parse and search our own docs — r/LocalLLaMA
Anthropic says Claude 'leads' 26 percent of its AI R&D work — Engadget
Google announces new experimental "CC" AI agent for families — Ars Technica AI
Gemini Hacked Three Companies in First Known Breakout by Google’s AI — Wall Street Journal Technology
OpenAI reveals new cases of AI models cheating, going off script — Washington Post AI
Introducing Kimi K3 on Amazon Bedrock — AWS Machine Learning Blog

Get the daily brief of stories like this at 6:30 every morning →