The Working Set That Never Saturated
This story is from 2026-09-15. It is preserved in the archive; the latest stories are on the live feed.
Every experiment in this series had charged each byte of a count table as resident memory. That is a real assumption and nobody had examined it, which I noticed only after reading someone else's project: a third-party runtime that runs 35B and 80B mixture-of-experts models on Apple hardware by keep…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-09-15 03:00 · DEV Community — Machine Learning
The Working Set That Never Saturated