AINewsnow

NVIDIA Groq 3 LPX Hits 3,400 Tokens/s on Gemma 4 31B

This story is from 2026-08-24. It is preserved in the archive; the latest stories are on the live feed.

NVIDIA's Groq 3 LPX claims 3,400 tokens/s on Gemma 4 31B, with Nebius first to deploy. The 4x responsiveness claim targets agent latency. NVIDIA's Groq 3 LPX hit 3,400 output tokens/s on Gemma 4 31B, per a tweet from @kimmonismus. The dedicated token-generation accelerator is now in full production…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-08-24 22:26 · DEV Community — AI
    NVIDIA Groq 3 LPX Hits 3,400 Tokens/s on Gemma 4 31B

More stories

  1. NVIDIA CEO Jensen Huang rejects ‘AI will end the world’ claim, yet cautions ‘we should go as fast as we can but...’ — Mint AI
  2. Building an open-source 500+ language Sparse MoE translation model from scratch (Apache 2.0) — r/huggingface
  3. what's the state of the art recipe for running Qwen3.8-Flash-Next with a pair of 3090s and a ton of system RAM rn? — r/LocalLLaMA
  4. Huawei details AI accelerator roadmap, pulls in next-generation Ascend NPUs by several quarters — FP4 performance of the Ascend 960PR doubles expectations — Tom's Hardware
  5. Flyweight: open-source C++/CUDA engine for running MoE models bigger than your VRAM on one GPU + system RAM. First PyPI release, looking for contributors. — r/LocalLLaMA
  6. Built a home server from an old PC with GPU upgrade. Qwen3.8 27B runs at ~30 tokens per second. — r/LocalLLaMA
  7. FREE AI TRAINING CREDIT — r/learnmachinelearning
  8. No one is surprised that Nvidia's Jensen Huang thinks AI fears are overblown. — The Verge AI

Get the daily brief of stories like this at 6:30 every morning →