US Urged to Build Verified AI Code Standards for Critical Systems as 90 Flaws Expose Risks
Updated
Updated · TIME · Aug 20
US Urged to Build Verified AI Code Standards for Critical Systems as 90 Flaws Expose Risks
3 articles · Updated · TIME · Aug 20
Summary
Mathematical verification should become a U.S. national mission for AI-generated code, the report argues, especially in hospitals, banks and power grids where software failures can harm millions.
Formal methods would translate AI output into machine-checkable proofs, shifting the bottleneck from endless AI discovery to human-set specifications that define what critical systems must and must not do.
Recent incidents underscore the risk: Anthropic in April limited Mythos access after it found unknown vulnerabilities, Microsoft later identified 90 critical flaws, and Sen. Mark Warner said in June the tool breached nearly all classified systems within hours.
A July 2024 faulty software update that grounded flights and disrupted hospitals showed that non-malicious code errors can already cause global damage, a threat amplified by fast-growing 'vibe coding' nobody fully understands.
The report calls for open verified-component libraries, standards, update-checking tools and cross-agency training, alongside sustained investment in mathematics research that underpins trustworthy AI software.