Anthropic CEO Dario Amodei told the 15-member council, which ‌is charged with maintaining international peace and security, that if managed poorly, he believed "AI could be a risk to humanity as a whole." The meeting comes amid warnings that AI systems could soon improve themselves and slip beyond human control. “No leader, no company and no nation can manage this alone," Amodei said.

Hugging Face co-founder Clément Delangue highlighted the role of AI tools in defending against cyberattacks, citing an incident in which US giant ​OpenAI's AI agents breached Hugging Face's infrastructure after escaping their testing environment. OpenAI CEO Sam Altman said international ​cooperation was needed.

“If AI is to be democratic, the most important decisions cannot be made by labs in San Francisco alone. They must be shaped through democratic processes and by governments accountable to the ‌people they serve," ⁠Altman told the council.

As the council met, Australian Prime Minister Anthony Albanese told reporters in New York that an AI agent developed by OpenAI infiltrated an Australian government website in June, accessing public and non-public files.

Yoshua Bengio, a Canadian considered one of the "Godfathers of AI" told the Security Council: "The dangers are real and imminent."