New ADIndex Method Adds Layer-Adaptive Sparse Attention Indexing via Group-Level Distillation
A new paper, ADIndex, proposes layer-adaptive sparse attention indexing trained via group-level distillation, addressing the cost of DeepSeek Sparse Attention's indexer, which still scores all tokens despite token-level selection.
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-11-11 05:00 · arXiv cs.LG
ADIndex: Layer-Adaptive Sparse Attention Indexing via Group-Level Distillation
More stories
- DeepSeek's Harness agent app reaches 1.54 million daily users — Bloomberg AI
- Local AI inference gains ground as compact desktop hardware and new Mac app target on-device model serving — DEV Community — Machine Learning
- Xolotl - running a 552-billion MoE on one gaming PC, and what it asks of a constrained machine — DEV Community — Machine Learning
- DeepSeek V4.1 Flash API: Clean and Tag 10,000 Comments, and What It Costs — DEV Community — AI
- SWE-Pair: a coding-agent benchmark where every task is two real bugs to fix at once, with results from four models [P] — r/MachineLearning
- How Often Do AI Labs Ship New Models? Release Cadence of OpenAI, Anthropic, Google, DeepSeek and Mistral (2024-2026) — DEV Community — AI
- GPT 6 Instant is Terrible — r/ChatGPT
- How I Cut My LLM Bill by Routing Off-Peak Traffic to Discounted DeepSeek — DEV Community — AI
Get the daily brief of stories like this at 6:30 every morning →