AINewsnow

Your model card says 128k. The machine serving it picked 4k.

I got this one wrong first, and the reason is worth more than the correction. I assumed the effective context window was a property of the model file. Dump the GGUF header, read context_length , compare it against what the model card claims, done. That check is real, but it answers a narrower quest…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-11-03 02:07 · DEV Community — AI
    Your model card says 128k. The machine serving it picked 4k.

More stories

  1. OpenAI appoints former US Army Secretary Dan Driscoll as Senior Counselor for National Security Modernization — OpenAI News
  2. Anthropic reports $17B quarterly revenue, $900B spending commitments ahead of IPO — Reuters AI
  3. OpenAI to merge ChatGPT's Chat and Work tabs into a single desktop experience — TechCrunch AI
  4. Marvell to acquire Lumentum in $115 billion all-stock AI data-centre deal — DigiTimes Asia
  5. Apple CEO John Ternus says company won't ship AI for AI's sake — Techmeme
  6. OpenAI and Anthropic set up 'war rooms' to monitor AI content ahead of midterms — Semafor Technology
  7. Anthropic confirms new Claude Code limits to prevent recreating existing video games — Engadget
  8. OpenAI launches Grid Protectors Program to cut data center power use during grid strain — OpenAI News

Get the daily brief of stories like this at 6:30 every morning →