AINewsnow

AI giants agree on robots.txt opt-out as markets wobble

2026-11-02

AI giants agree on robots.txt opt-out as markets wobble

The industry's biggest players moved toward a shared standard for AI training opt-outs, even as investor nerves over AI spending rattled markets. Anthropic's IPO filing and OpenAI's trimmed funding round put the sector's finances under a rare spotlight. Meanwhile, agentic coding tools kept multiplying — and so did their security risks.

  1. Google, OpenAI, Microsoft and Anthropic to honor shared robots.txt opt-out The four AI companies announced plans to honor a shared robots.txt signal based on IETF AIPREF work, letting websites opt out of AI training with one machine-readable preference. The announcement came October 30-31, 2026.
    Why it matters: A unified opt-out standard could finally give publishers a practical way to control how their content trains AI models.
  2. Claude Code ecosystem grows — with a backdoored extension in the wild New tools let Claude Code delegate tasks to Codex and Gemini, run agents side by side, and share configs across repos. Separately, researchers found a backdoored Claude Code extension circulating in the wild.
    Why it matters: Multi-agent workflows are becoming mainstream fast, but the discovery of a malicious extension shows the security model hasn't caught up.
  3. DeepSeek open-sources dsh-superagent coding agent prototype DeepSeek's Harness team released dsh-superagent, an MIT-licensed research prototype that turns GitHub and Feishu requests into parallel worker sessions. Self-simulated results showed a p95 task completion time of 15.7 minutes versus 29.5 minutes.
    Why it matters: An open-source router-worker agent gives developers a free template for parallelizing coding work across model ecosystems.
  4. Apple Intelligence lands in China in December with Alibaba's Qwen Apple confirmed its first Apple Intelligence features will reach mainland China in December with iOS 27.3, following a developer beta starting November 4. Alibaba's Qwen model will power Siri and Writing Tools, ending a two-year wait.
    Why it matters: Partnering with Alibaba's Qwen marks a major concession to Chinese regulations and opens Apple's largest untapped market to AI features.
  5. Anthropic files for blockbuster IPO; Blackstone flags junk rating Anthropic filed paperwork for a large IPO, offering a rare public look at a major AI company's financials. Blackstone expects the AI group to receive a 'high' junk rating after listing, a shift from previous guidance.
    Why it matters: The filing will expose hard numbers on AI profitability for the first time, and a likely junk rating signals Wall Street's skepticism about the sector's debt.
  6. OpenAI plans post-midterms push for AI 'speed limits' OpenAI is planning a post-midterms policy and PR campaign pushing mandatory speed limits for powerful AI, alongside rebranding data centers as 'AI compute campuses' amid public backlash. Sam Altman also visited Samsung and SK in South Korea.
    Why it matters: OpenAI embracing regulation of frontier AI could reshape the policy debate, while the data center rebrand shows how sensitive the infrastructure buildout has become politically.
  7. Tech stocks slide as AI spending concerns mount The Nasdaq posted its biggest decline since June as disappointing Big Tech earnings and heavy AI spending fueled investor concerns. S&P turned negative on Meta's credit outlook, and Big Tech buybacks fell 83%.
    Why it matters: Markets are starting to price in the risk that massive AI capex won't pay off quickly, raising the stakes for upcoming earnings seasons.
  8. OpenAI lowers funding target to $20 billion OpenAI reportedly cut its latest funding round target from $30 billion to $20 billion, securing about $11 billion so far amid a more cautious investor climate around heavy AI infrastructure spending. The round remains open.
    Why it matters: A downsized round at the sector's most prominent startup is a clear signal that investor enthusiasm for AI infrastructure is cooling.
  9. Apple CEO John Ternus: no AI for AI's sake In a WIRED interview published October 30, Apple CEO John Ternus defended the company's AI strategy, saying it won't ship AI for AI's sake and wants products people love without thinking about AI. He said Tim Cook is available to help on policy matters.
    Why it matters: Ternus is staking Apple's identity on restraint in an industry racing to ship AI everywhere, a bet that could define the post-Cook era.
  10. SemiAnalysis launches GDPx agentic benchmark; Opus 5.5 tops it SemiAnalysis released GDPx on November 2, 2026, a benchmark for general agentic capabilities spanning 11 professional domains including chip design, cybersecurity, and RSI. Anthropic's Opus 5.5 topped the benchmark with a 12% score.
    Why it matters: A 12% top score on a broad agentic benchmark quantifies just how far agents remain from human-level professional work.