AINewsnow

[Paper] FlashMask-3: Efficient and Expressive Mask-Aware Distributed Attention

Long-context training of large language and multimodal models couples structured attention masks (document, prefix-LM, share-question, sliding-window, block-sparse) with multi-node context parallelism, making the mask a dominant bottleneck. FlashMask's column-wise sparse mask compresses them from O…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-20 14:02 · r/LocalLLaMA
    [Paper] FlashMask-3: Efficient and Expressive Mask-Aware Distributed Attention

More stories

  1. DeepSeek releases DeepSeek-V4.1-Flash-1017 open weights under the MIT license — r/huggingface
  2. OpenAI acquires Orchestra Bio — OpenAI News
  3. Build a semantic layer for agentic AI on AWS with AtScale and Amazon Bedrock AgentCore — AWS Machine Learning Blog
  4. DHS Orders DeepSeek Technology Removed From Federal Civilian IT Systems — Wall Street Journal Technology
  5. Ex-OpenAI worker accused of bugging offices planned to 'flee' to Saudi Arabia, prosecutors say — Sky News Technology
  6. FairStress: A deeper evaluation of fairness in LLM decision-making — Allen Institute for AI (Ai2)
  7. DeepSeek open-sources DeepInfer, its high-performance inference framework that powers its production services, starting with support for DeepSeek-V4.1-Flash — Techmeme
  8. ALTK-Evolve: How learned memory tops the τ²-bench leaderboard on customer service tasks without a frontier model — Hugging Face Blog

Get the daily brief of stories like this at 6:30 every morning →