Running an embedding model on Apple's Neural Engine from Rust
Every Apple silicon Mac has a Neural Engine, and most of the time it sits idle. I wanted it to do my embeddings. It took a lot longer than I expected, and most of what I learned isn't in the docs, so here it is. The context is a local code search tool I build in Rust. It embeds every chunk of code…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-07 10:50 · DEV Community — Machine Learning
Running an embedding model on Apple's Neural Engine from Rust