AINewsnow

Gewell - Gemma4 inference engine

# the What An engine to run Gemma 4 31B on blackwell under massive concurrency and rather specific workload patterns. I've been waiting for someone to do ninfer but for gemma, and, well, ended up having to do it myself. More models and potentially more gpus are likely to be added, but its main purp…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-09-21 09:56 · r/LocalLLaMA
    Gewell - Gemma4 inference engine

More stories

  1. Introducing Kimi K3 on Amazon Bedrock — AWS Machine Learning Blog
  2. Gemini Hacked Three Companies in First Known Breakout by Google’s AI — Wall Street Journal Technology
  3. Anthropic, OpenAI, SpaceXAI, Google sued over call to ‘pace’ AI development — Politico Technology
  4. NVIDIA CEO Jensen Huang rejects ‘AI will end the world’ claim, yet cautions ‘we should go as fast as we can but...’ — Mint AI
  5. Meet the Data Agent in ChatGPT Work — OpenAI YouTube
  6. Google Rolls Out $899-Plus Googlebooks from Dell, HP, Lenovo, Acer, ASUS — Bloomberg AI
  7. AI hallucination of Chinese nuclear components almost led to US military attack — Ars Technica AI
  8. The new AgentCore runtime: Elastic, optimized, and consistently fast starts — AWS Machine Learning Blog

Get the daily brief of stories like this at 6:30 every morning →