AINewsnow

AI Safety Warnings Mount as Mistral Raises €3B and UK Policy Architect Quits

2026-09-08

AI Safety Warnings Mount as Mistral Raises €3B and UK Policy Architect Quits

The AI industry faces a convergence of regulatory scrutiny and safety concerns, with top officials from OpenAI and the UN warning of existential risks. Meanwhile, European AI champion Mistral secures massive funding, and the UK's AI policy landscape is shaken by a high-profile resignation.

  1. OpenAI Chief Scientist Warns of AI Manipulation and Blackmail Risks OpenAI Chief Scientist Jakub Pachocki stated that humanity is entering an era of increasingly capable AI systems without having fully solved monitoring or alignment. He warned that advanced AI could potentially manipulate, bargain with, or blackmail humans, calling for stronger safeguards and international coordination.
    Why it matters: This marks a significant shift in tone from OpenAI's leadership, acknowledging that current safety measures may be insufficient for next-generation models.
  2. UN Human Rights Chief Labels Advanced AI an 'Existential Risk' UN human rights chief Volker Türk warned that advanced AI could pose an existential risk to humanity. He urged governments and tech firms to establish safety red lines, ensure independent verification, and foster global cooperation before risks escalate.
    Why it matters: High-level UN warnings add diplomatic pressure on tech companies and governments to formalize AI safety protocols on a global scale.
  3. Mistral AI Valued at €21 Billion After Samsung-Led €3B Round Mistral AI has raised €3 billion ($3.5 billion) in a Series D funding round led by Samsung Electronics, boosting its valuation to over €21 billion. The funds will support the development of AI models and the construction of computing infrastructure.
    Why it matters: This massive injection of capital solidifies Mistral's position as a leading European AI player and signals strong industrial backing for sovereign AI development.
  4. UK AI Policy Architect Resigns Over Anthropic Conflict of Interest Matt Clifford, the architect of the UK's AI policy, has resigned after taking a full-time job at AI company Anthropic. The move sparked disquiet among senior MPs who raised concerns about potential conflicts of interest.
    Why it matters: The resignation highlights the growing tension between government regulators and the private AI sector, raising questions about the integrity of policy-making.
  5. Seattle Times and Newsday Sue OpenAI and Microsoft for Copyright Infringement The Seattle Times and Newsday have joined the growing list of news organizations suing OpenAI and Microsoft. They allege that their journalism was used to train AI models without permission or compensation.
    Why it matters: These lawsuits expand the legal front against major AI labs, potentially setting precedents for how copyrighted content is used in model training.
  6. OpenAI and Partners Launch AI Program for Ukrainian Journalism OpenAI, AIRPPU, and WAN-IFRA have launched an AI program designed to help Ukrainian news organizations strengthen innovation, resilience, and independent journalism. The initiative aims to support media outlets in a conflict zone.
    Why it matters: This demonstrates a practical application of AI technology for humanitarian and democratic goals, contrasting with the commercial and safety-focused narratives dominating the news.