LFM3-Omni-2B running locally in-browser on WebGPU
The first true omni model that can run 100% locally in a browser... fully end-to-end, with no separate ASR or TTS models needed. With custom WebGPU kernels, we're able to run LFM3-Omni-2B at ~280 tok/s on an M4 Max, accepting visual, audio, or text and producing interleaved text and audio tokens. J…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-30 16:43 · r/LocalLLaMA
LFM3-Omni-2B running locally in-browser on WebGPU