AINewsnow

8 agents × 250K context, concurrently, on two 3090s (~600+ tok/s total)

I am open to the idea that I am misguided, but my findings feel worth sharing: Short video of my UI with 8 agents each explaining a codebase in parallel long prose: https://imgur.com/JSqlXIi A few days ago I read the Stanford/Berkeley TokenGate paper . The idea is to make long context cheap by prun…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-11-02 01:19 · r/LocalLLaMA
    8 agents × 250K context, concurrently, on two 3090s (~600+ tok/s total)

More stories

  1. Malicious Claude Code extension pulled from Cursor marketplace after SSH backdoor attempt — Microsoft Research Blog
  2. DeepSeek open-sources dsh-superagent, an autonomous coding agent prototype — Bloomberg AI
  3. Anthropic updates Claude Code to block recreation of existing video games — Engadget
  4. Elon Musk says Grok Bot usage limits imposed as serving costs were 'unsustainably high' — Forbes AI
  5. Marvell to buy Lumentum in $115 billion all-stock AI data-center deal — CNBC Technology
  6. Anthropic files for IPO as Blackstone flags likely 'high' junk rating — Financial Times AI
  7. OpenAI pivots to 'AI compute campuses' and energy partnerships amid chip supply strain — Data Center Dynamics
  8. OpenAI lowers latest funding round target to $20 billion from $30 billion — Financial Times AI

Get the daily brief of stories like this at 6:30 every morning →