As artificial intelligence becomes more autonomous and capable, warnings from researchers inside the industry are intensifying the debate over whether humanity can maintain control of increasingly powerful AI systems.
Artificial intelligence is advancing at extraordinary speed, bringing enormous opportunities in science, healthcare, business and productivity. But alongside those advances, a much darker question is receiving increased attention from researchers, policymakers and technology leaders: Hubinger has placed his personal estimate of the probability of an AI-related catastrophe resulting in human extinction at greater than 10% within roughly the next decade.