AINewsnow

Gemma 4 QAT on One TPU v5e: What Runs and What Doesn't

This story is from 2026-10-02. It is preserved in the archive; the latest stories are on the live feed.

This article provides a step by step guide to repacking Google's quantization-aware-trained (QAT) Gemma 4 weights for vLLM and serving them on one Google Cloud TPU v5e chip, with every build scored for classification, math, tool calling, throughput and long prompts. Every per-record output, log and…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 2 reports

  1. 2026-10-02 17:59 · DEV Community — Machine Learning
    Repacked QAT Gemma 4 on One TPU v5e: 12B Serves at 675 Tokens per Second
  2. 2026-10-02 16:59 · DEV Community — Machine Learning
    Gemma 4 QAT on One TPU v5e: What Runs and What Doesn't

More stories

  1. OpenAI launches GPT-6.2 Astra and Sol as Google ships Gemini 4 Neon and Microsoft unveils MAI Code 2 — OpenAI News
  2. Google launches Gemini 4 Neon and opens Genie 4 world model to Gemini API developers — Google DeepMind YouTube
  3. Google books Blue Origin's New Glenn for 2029 launch of AI server satellites — Google: The Keyword
  4. ChatGPT, Claude, Gemini and Grok helped plan terror attacks in US government test — The Independent Tech
  5. Google Adds Computer Use to Gemini App for Mac — Techmeme
  6. Google Introduces Tool Retrieval in Preview for Gemini API — Google: The Keyword
  7. Developers increasingly run Claude Code alongside rival coding agents and alternative backends — DEV Community — AI
  8. Google Builds 'Mirror Dimension' Synthetic Internet to Test Chrome AI Browsing Agents — Wired AI

Read the Daily Brief: the day's most important AI stories →