[Research] 2,788 tokens/s on a single RTX 5090 with a diffusion LLM — Introducing ORL (fully open source) [R]
This story is from 2026-10-16. It is preserved in the archive; the latest stories are on the live feed.
Hey r/MachineLearning ! We're excited to share ORL (On-Policy Residual Learning) , our new research on making diffusion language models (dLLMs) significantly faster without sacrificing generation quality. With ORL and our custom inference engine dlmrt , we've achieved: 2,788 tokens/s on a single RT…
Read the full story at r/MachineLearning ↗
Timeline · 1 report
- 2026-10-16 20:03 · r/MachineLearning
[Research] 2,788 tokens/s on a single RTX 5090 with a diffusion LLM — Introducing ORL (fully open source) [R]