Micron's memory wall chart. Compute up ~3x every two years, HBM bandwidth under 2x
This story is from 2026-09-14. It is preserved in the archive; the latest stories are on the live feed.
From Raghu Sreeramaneni's memory tutorial at hot chips 2026. top line is normalised tflops for tpu v3 through r200, bottom line is hbm2e through hbm4, both log scale, so the distance between them is a lot wider than it looks. The three boxes down the right are the fixes people are actually building…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-14 02:56 · r/LocalLLaMA
Micron's memory wall chart. Compute up ~3x every two years, HBM bandwidth under 2x
More stories
- Trump announces a new 'AI Force,' but says he will not 'stifle' AI — Business Insider AI
- Introducing Kimi K3 on Amazon Bedrock — AWS Machine Learning Blog
- Introducing Amazon SageMaker HyperPod Inference Gateway — AWS Machine Learning Blog
- Introducing Astra for Law — OpenAI News
- Anthropic, OpenAI, SpaceXAI, Google sued over call to ‘pace’ AI development — Politico Technology
- Google's Gemini AI hacks three other companies during security test — Sky News Technology
- Sources: Anthropic considers releasing a new AI model to counter OpenAI's momentum since Astra's launch, ahead of an IPO and after Amodei's call for a slowdown (Reuters) — Techmeme
- Gemini Hacked Three Companies in First Known Breakout by Google’s AI — Wall Street Journal Technology
Get the daily brief of stories like this at 6:30 every morning →