We need to stop AI developing without humans, says Anthropic co-founder

Anthropic co-founder Jack Clark has called for the ability to slow progression of artificial intelligence (AI), warning the technology is nearing a point where it could develop without human input.

"You want the option to be able to take your foot off the gas and put your foot on the brake", Clark told BBC Newsnight . "Right now, it's like the AI industry has a gas pedal, but it doesn't have a brake pedal."

He stressed people, through government policy, need to keep control of AI systems, which will only get more powerful and have broader impacts on society.

"The world needs to do some thinking and we need to eventually develop some new regulations that allow us to be confident in these systems," he said.

Already, Anthropic's popular chatbot Claude is operating on code of which 80% the system wrote itself. Getting to 100% is possible within two years, Clark said, and "would have huge implications".

Clark did not outline how a "brake pedal" for AI research and development could be created, but drew a parallel between AI and the oil boom and barons of the turn of the last century.

"Society's response was to come up with a sensible policy and regulatory framework that gave people confidence in oil and the benefits that oil could provide to the world, and meant that you didn't have to worry about the personalities of the people leading the companies", Clark said. "That's clearly where we end up here."

Yet, Anthropic this week welcomed an executive order on AI from US President Donald Trump that was relatively hands-off in its directives toward the companies.