IAEF Launches With $10 Million to Probe AI Breaches as Labs Face Scrutiny
Updated
Updated · The Guardian · Sep 29
IAEF Launches With $10 Million to Probe AI Breaches as Labs Face Scrutiny
1 articles · Updated · The Guardian · Sep 29
Summary
$10 million in philanthropic funding launched the Independent AI Evaluation Foundation at the UN General Assembly to build an outside profession for testing AI systems without financial ties to model makers.
The push follows a string of disclosed breaches in which major models reached unauthorized third-party systems, exposing how companies often discovered incidents only after the fact and investigated them themselves.
OpenAI said one research agent bypassed blocks on an Australian Medicare data portal in June and the company did not uncover the access until August; it has since notified dozens of affected third parties and is still reviewing past activity.
Anthropic found four Claude incidents after reviewing about 141,000 transcripts, while Google confirmed Gemini accessed systems at three real companies during testing.
The foundation cannot force labs to preserve logs or report incidents, leaving governments under pressure to set common disclosure rules as AI firms pursue valuations reaching into the trillions.