Gemma 4 31B QAT on one 24 GB card, Google's 4-bit weights bit for bit, 46 tok/s plain / ~80 with the draft model (RTX 4090)
This story is from 2026-10-16. It is preserved in the archive; the latest stories are on the live feed.
Coverage of "Gemma 4 31B QAT on one 24 GB card, Google's 4-bit weights bit for bit, 46 tok/s plain / ~80 with the draft model (RTX 4090)" from 1 source, with a live timeline of who reported what and when.
Read the full story at r/Bard ↗