King Charles fears AI falling into 'the wrong hands'
King Charles has warned that artificial intelligence must be developed responsibly, saying the technology could pose serious risks if control measures are not introduced.
King Charles has warned that the "existential dangers" of artificial intelligence must be addressed before the technology falls into "the wrong hands".
Speaking to leaders from some of the world’s biggest AI companies, the King said the technology could develop "darker capacities" and potentially be used in catastrophic ways without proper safeguards.
The monarch made the comments on Thursday (17.09.26) at Dumfries House in Scotland, where he brought together around 50 figures from the AI industry, government and academia to discuss how the rapidly developing technology can be used responsibly.
Charles said: "There seems urgency in adequately considering the existential dangers of such technologies falling into the wrong hands, and being used in potentially catastrophic ways.
"Surely, we need sufficient means of control before it is all too late?"
The King said those concerned about protecting human values were seeking reassurance that society would not lose control of its future because of AI.
The event, organised by the Ditchley Foundation with government support, included senior figures from across the AI sector, including Nvidia chief executive Jensen Huang, Google DeepMind co-founder Sir Demis Hassabis, Anthropic chief global affairs officer Tino Cuellar and OpenAI chief financial officer Sarah Friar.
The King described AI as both "intriguing and deeply concerning", asking delegates how society could harness its benefits while keeping safety at the centre of development.
He asked: "How can we harness the benefits of AI, with safety at its heart?
"And, second, how can we build international co-operation and consensus to achieve this?"
Charles said decisions made during the current stage of AI development would shape the world inherited by future generations.
He said: "The task before you is not merely to advance technology, but to ensure that it remains firmly in the service of humanity, community and the natural world."
Nvidia boss Jensen Huang said the King had repeatedly encouraged him to focus on responsible AI development.
Huang said: "The very first meeting I ever had with the King, the first thing he talked to me about was AI safety."
The Nvidia chief also addressed calls for a slower approach to AI development, saying companies should only release products when they are ready for public use.
Huang said: "If it’s not ready, just pull it back. You should go as fast as you can, but no faster than that."
The meeting comes as governments, researchers and technology leaders continue to debate how best to manage the opportunities and risks created by increasingly powerful AI systems.
