Hand-writing a tiny CNN beats inference engines
This story is from 2026-08-28. It is preserved in the archive; the latest stories are on the live feed.
Hi everyone! I tried optimizing a tiny CNN on a Raspberry Pi and ended up 3x faster than the inference engines (ONNX Runtime, ncnn). I wrote the code from scratch, starting with a naive implementation, then SIMD, and finally operator fusion. Each improvement only changes a few dozen lines of code.…
Read the full story at r/computervision ↗
Timeline · 1 report
- 2026-08-28 12:26 · r/computervision
Hand-writing a tiny CNN beats inference engines