Together AI unveils Together Compiler, an AI agent tool that rewrites GPU kernels
This story is from 2026-11-16. It is preserved in the archive; the latest stories are on the live feed.
Together Compiler uses AI agents to rewrite and fuse GPU kernels in a model's forward pass, replacing hand-written megakernels. It reports 28% higher throughput on B200, reaching 2,118 tokens/s versus 1,649 on Llama 3.2 1B.
Read the full story at Together AI Blog ↗
Timeline · 1 report
- 2026-11-16 00:00 · Together AI Blog
Last year we built megakernels. This year we deleted them: The road to Together Compiler