I added OpenVINO support to Laya: 40 ms per question on CPU, 3.4x faster than PyTorch
GitHub repo : https://github.com/rupeshs/laya-openvino Flappy bird demo : https://github.com/rupeshs/flappy-laya-openvino-cpu
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-25 00:37 · r/LocalLLaMA
I added OpenVINO support to Laya: 40 ms per question on CPU, 3.4x faster than PyTorch