AINewsnow

Can You Run Inkling 2 Small Locally? 17B Active, but Plan on 200 GB

You can't run Inkling 2 Small locally yet. Thinking Machines shipped the 594B model on November 5, 2026 with closed weights on Tinker , and the Apache 2.0 weights are only promised for next week. When they land, my math says a 2-bit GGUF will want 190 to 200 GB of RAM plus VRAM, so one 128 GB box i…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-06 19:50 · DEV Community — Machine Learning
    Can You Run Inkling 2 Small Locally? 17B Active, but Plan on 200 GB

More stories

  1. Thinking Machines releases Inkling 2 Small, claiming top western open-weight model — ZDNET AI
  2. Dense Models, Mixture-of-Experts, and Agent Memory Architectures — DEV Community — Machine Learning
  3. Six things happened in AI today; the one worth your attention is ChatGPT Cyber. — DEV Community — Machine Learning
  4. Inkling 2 Small is cheap per token but writes a lot: what 150,000 output tokens per task does to the price — DEV Community — Machine Learning
  5. AI Models Advance as Wall Street Grows Wary of Exponential Optimism — TheSequence
  6. Gemini Omni 1.2 Flash Is 30% Cheaper. Your 1.1 Calls Move to It on December 3 Anyway — DEV Community — AI
  7. Inkling 2 Small: A Developer's Checklist Before You Bet a Pipeline on a Model With No Weights Yet — DEV Community — AI
  8. Inkling 2 Small on Tinker Today: 594B/17B MoE, AA Index 31, Apache Weights Next Week — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →