AINewsnow

Ling-3.1-flash and the 7:1 hybrid: how much KV cache does a 560B model need at 1M tokens?

This story is from 2026-10-19. It is preserved in the archive; the latest stories are on the live feed.

TL;DR Ling-3.1-flash (MIT license, 560B total, 25B active, weights on Hugging Face since 2026-10-13) replaces most of its attention layers with linear attention: 63 Kimi Delta Attention (KDA) layers and only 9 gated Multi-head Latent Attention (MLA) layers, a 7:1 ratio. Only the 9 MLA layers keep a…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-10-19 13:26 · DEV Community — Machine Learning
    Ling-3.1-flash and the 7:1 hybrid: how much KV cache does a 560B model need at 1M tokens?

More stories

  1. Gemini 4 Argon is fascinating — r/GeminiAI
  2. Tried Cline for a week after living in Claude Code and Codex, some notes — r/ChatGPTCoding
  3. Chinese models for vibe coding (Kimi, DeepSeek, GLM) — r/AI_Agents
  4. vLLM's Kimi K3 Backend Hits 842 Tokens per Second on NVIDIA Blackwell GPUs — AlphaSignal
  5. Reporter’s notebook: Kimi’s AI credit card turns spending into computing quotas – with limits — South China Morning Post Tech
  6. Kimi K3, three months after the hype: too big for almost anyone to run locally, and smaller models have already caught it — r/LocalLLaMA
  7. DeepSeek V4.1 Flash 1017 now available on AI Gateway — Vercel Blog
  8. inclusionAI/Ming-3.0-audio-flash · Hugging Face — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →