AINewsnow

Gemma 4 in Pure JAX: What Changes Between Turing and Ada, and What Doesn't

This story is from 2026-08-31. It is preserved in the archive; the latest stories are on the live feed.

This article is a measurement report on running a hand-written Gemma 4 port in pure JAX across two NVIDIA GPUs a generation apart, and on the two places the "it's just JAX" abstraction leaks. One of those leaks costs 87% of decode and nothing in the logs is red. The code is here: https://github.com…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-08-31 01:40 · DEV Community — Machine Learning
    Gemma 4 in Pure JAX: What Changes Between Turing and Ada, and What Doesn't

More stories

  1. Amid growing AI fears, King Charles meets with industry leaders in Scotland — NPR Technology
  2. Fault tolerant distributed training on Amazon EKS using NVRx — AWS Machine Learning Blog
  3. King Charles to press Nvidia, OpenAI, Anthropic leaders on AI safety at summit — CNBC Technology
  4. Huawei details AI accelerator roadmap, pulls in next-generation Ascend NPUs by several quarters — FP4 performance of the Ascend 960PR doubles expectations — Tom's Hardware
  5. Flyweight: open-source C++/CUDA engine for running MoE models bigger than your VRAM on one GPU + system RAM. First PyPI release, looking for contributors. — r/LocalLLaMA
  6. Deployed Qwen 3.6 35B A3B on a single DGX Spark supporting 12 concurrent users at 262K context. Are there better ways to optimize this? — r/LocalLLM
  7. Huawei unveils latest tech to boost AI power in push to break China’s Nvidia reliance — South China Morning Post Tech
  8. Beginner confused about Ollama vs LM Studio vs llama.cpp vs vLLM vs Unsloth — can someone explain? — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →