Voice conversations between Gemma4 12B and E2B on GPU and Jetson Orin
This story is from 2026-09-08. It is preserved in the archive; the latest stories are on the live feed.
Gemma 4 12B runs on an RTX PRO 4500 Blackwell. Gemma 4 E2B run on a Jetson Orin NX 16GB; similar performance is expected on a Jetson Orin Nano Super 8GB. Both systems use a reSpeaker Flex 4-mic array and a 3W speaker. Inference is handled by Cortexist Little Gemma, a small LLM engine written in C f…
Read the full story at r/LocalLLaMA ↗
Timeline · 2 reports
- 2026-09-08 04:43 · r/LocalLLM
Voice conversations between Gemma4 12B and E2B on GPU and Jetson Orin - 2026-09-08 04:36 · r/LocalLLaMA
Voice conversations between Gemma4 12B and E2B on GPU and Jetson Orin