AINewsnow

Zyphra releases ZHA, tree-indexed sparse attention retrofitted onto frozen LLMs (96.2% RULER-13 at 256K)

Zyphra published Zyphra Hierarchical Attention (ZHA), a sparse attention method that replaces the flat token indexer with a tree. Summary keys are built over the KV cache level by level, and each query descends the tree with top-p routing before running exact attention on the selected keys. It is d…

Read the full story at r/machinelearningnews ↗

Timeline · 1 report

  1. 2026-11-03 01:16 · r/machinelearningnews
    Zyphra releases ZHA, tree-indexed sparse attention retrofitted onto frozen LLMs (96.2% RULER-13 at 256K)

More stories

  1. OpenAI appoints former US Army Secretary Dan Driscoll as Senior Counselor for National Security Modernization — OpenAI News
  2. Anthropic reports $17B quarterly revenue, $900B spending commitments ahead of IPO — Reuters AI
  3. AI and tech stock slide in October tests broader US market resilience — Reuters AI
  4. Marvell to acquire Lumentum in $115 billion all-stock AI data-centre deal — DigiTimes Asia
  5. OpenAI cuts funding target to about $20 billion as tech stocks sell off — Economic Times Tech
  6. Anthropic SEC filing warns of imminent threshold for AI-driven research acceleration — TechCrunch AI
  7. OpenAI and Anthropic set up 'war rooms' to monitor AI content ahead of midterms — Semafor Technology
  8. OpenAI to merge ChatGPT's Chat and Work tabs into a single desktop experience — TechCrunch AI

Get the daily brief of stories like this at 6:30 every morning →