We open-sourced Paddock, our Rust/C++ inference engine with its own CUDA kernels (MIT/Apache-2.0)
This story is from 2026-09-04. It is preserved in the archive; the latest stories are on the live feed.
I'm one of the developers. We said in August it would go open source in September and it did last night. MIT or Apache-2.0, pick one. The repo you see is our internal repo, kernels included, so from now on everything happens in public. It's an inference engine in Rust and C++ with our own CUDA kern…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-04 09:15 · r/LocalLLaMA
We open-sourced Paddock, our Rust/C++ inference engine with its own CUDA kernels (MIT/Apache-2.0)