AINewsnow

25 LLM architecture blocks, side by side, in runnable PyTorch

This story is from 2026-09-24. It is preserved in the archive; the latest stories are on the live feed.

GPT-2 to Kimi Linear is seven years of architecture research, and almost all of it fits in about twenty lines per model. Below are 25 decoder blocks — GPT-2, OPT, Llama 2/3/4, Gemma 2/3, Qwen 2.5/3/3-Next/3.5, OLMo 1/3, DeepSeek-V3, Phi-3/4, MiniMax-M2/M2.5, Mistral Large 3, Mistral Small 3.1, Kimi…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-09-24 06:44 · DEV Community — Machine Learning
    25 LLM architecture blocks, side by side, in runnable PyTorch

More stories

  1. Blind listening test: 62 people compared 8-bar piano loops written by 8 LLMs (Gemini, Claude, Qwen, Kimi, Grok, GPT-6.1, DeepSeek, Llama). Interim results — r/artificial
  2. Config-Verified Comparison Maps How 10 Open MoE Models Route Tokens — MarkTechPost
  3. Zero-Downtime LLM Inference on Kubernetes Spot Instances (~70% GPU Cost Savings) — DEV Community — Machine Learning
  4. Llama vs Qwen vs DeepSeek: How Much VRAM Do You Need to Self-Host? — DEV Community — AI
  5. Your AI models can change. Your memory shouldn't. — DEV Community — AI
  6. Lessons from putting 14 coding-agent CLIs behind one interface — DEV Community — AI
  7. Moonshot Just Put a 2.8-Trillion-Parameter Model on Hugging Face — Kimi K3.1 Pro's Open Weights Are Real, and the Fine Print Matters — DEV Community — AI
  8. Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU — Hacker News Front Page

Get the daily brief of stories like this at 6:30 every morning →