Gemma 4 in Pure JAX: What Changes Between Turing and Ada, and What Doesn't
This story is from 2026-08-31. It is preserved in the archive; the latest stories are on the live feed.
This article is a measurement report on running a hand-written Gemma 4 port in pure JAX across two NVIDIA GPUs a generation apart, and on the two places the "it's just JAX" abstraction leaks. One of those leaks costs 87% of decode and nothing in the logs is red. The code is here: https://github.com…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-08-31 01:40 · DEV Community — Machine Learning
Gemma 4 in Pure JAX: What Changes Between Turing and Ada, and What Doesn't