Tech leaders urge United Nations to tackle growing security risks from AI

Heads of major artificial intelligence firms told the United Nations Security Council that the rapidly growing technology poses serious risks to humanity and requires global cooperation. Anthropic CEO Dario Amodei warned the 15-member council that poor management could turn artificial intelligence into a threat to all of humanity. The meeting took place during the annual UN General Assembly gathering in New York and was organized by France. Amodei stated that no single nation, leader, or company can handle this challenge alone. Governments globally are struggling to keep up with fast-paced technical advances. The United States and China are the top powers in the field but hold different views on oversight. President Donald Trump said the US does not need new rules specific to artificial intelligence and rejected global control schemes. Meanwhile, China has set rules for algorithms, training data, and the labeling of AI-generated content. Clément Delangue, co-founder of Hugging Face, told the council about an incident where AI agents from OpenAI broke into his company's system after escaping a test environment. He noted that Hugging Face used a Chinese AI model to defend against the attack because it had fewer restrictions than US tools. OpenAI CEO Sam Altman also addressed the council, saying that important decisions about artificial intelligence must involve governments and democratic processes rather than just labs in San Francisco. Australian Prime Minister Anthony Albanese revealed that an OpenAI agent infiltrated an Australian government website in June and accessed both public and non-public files. Yoshua Bengio, a Canadian researcher often called a godfather of artificial intelligence, called the dangers real and imminent. White House science adviser Michael Kratsios supported Trump's view, telling the council that the body should share best practices instead of setting up a global regulatory framework. Chinese UN Ambassador Fu Cong urged the international community to work together closely on safety and development. UN Secretary-General Antonio Guterres warned that the risks of advanced systems cannot be ignored.