AINewsnow

Inference on Google Cloud: Precision, Memory and Capacity on TPU, from v5e to Ironwood

This article is the written companion to the talk "Inference on Google Cloud". It covers serving Gemma 4 on Cloud TPU v5e and v6e through vLLM, measured on the gemma4-dev Cloud TPU test setups between July and October 2026, and compares them with the NVIDIA L4 on Google Cloud, Blackwell list prices…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-10-25 23:02 · DEV Community — Machine Learning
    Inference on Google Cloud: Precision, Memory and Capacity on TPU, from v5e to Ironwood

More stories

  1. Moonshot AI launches Kimi K3.1 Pro with better coding skills, reduced cyber risks — Mint AI
  2. Maya-XS runs DeepSeek-V4.1-Flash in 120.6 GB, with all 384 experts resident in GPU memory on a 128 GB Ryzen AI Max. — r/LocalLLaMA
  3. NVIDIA releases Nemotron 3.5 Bolt E4B - Runs locally on 6GB RAM. — r/LocalLLM
  4. testing minimax h3 ref2va with my ps2 style lora — r/StableDiffusion
  5. The Epoch Brief - October 23, 2026 — Epoch AI
  6. Google CEO Sundar Pichai reveals how AI agents help him keep up with company updates — Mint AI
  7. Scaling NVIDIA TensorRT Performance Optimization Beyond a Single Build Route with the Global Performance Tuner, Part 1 — NVIDIA Technical Blog
  8. Post-Training at the Frontier — CoreWeave Blog

Get the daily brief of stories like this at 6:30 every morning →