189 lines, 39 tests pass: I ran DeepSeek-V3 in pure JAX
This story is from 2026-11-15. It is preserved in the archive; the latest stories are on the live feed.
189 lines, 39 tests pass: I ran DeepSeek-V3 in pure JAX A Show HN post this week claims the whole DeepSeek-V3 architecture — MLA, DeepSeekMoE, aux-loss-free balancing, multi-token prediction — in 190 lines of pure JAX, pretrained from scratch on a MacBook Air. I counted 189 lines of actual code, ra…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-15 15:17 · DEV Community — Machine Learning
189 lines, 39 tests pass: I ran DeepSeek-V3 in pure JAX