Anthropic Researcher Resigns, Warns of AI Superintelligence Risks

A researcher at leading US artificial intelligence company Anthropic has resigned, warning that the uncontrolled pursuit of self-improving superintelligence could pose an existential threat to humanity within the next decade. British AI researcher Jacob Coxon announced his resignation on Tuesday, expressing deep concern over what he described as the technology industry’s reckless approach to developing increasingly powerful AI systems.

Coxon accused major technology companies of overlooking the broader consequences of the AI race, saying they were “racing straight to self-improving super-intelligence and gambling with our lives.” He argued that leading AI developers are prioritizing increasingly capable models and competition with one another, as well as with China, over adequate safety measures. He further warned that AI development could spiral “out of control” as early as the end of 2027 if safety concerns continue to be neglected.

Both Anthropic and OpenAI have publicly emphasized their commitment to AI safety and say they are investing heavily in measures to address potential risks. However, Coxon maintained that AI safety is being neglected on a global scale and that the race toward advanced systems is moving faster than the development of effective safeguards. His concerns have also been echoed by senior Anthropic researcher Evan Hubinger, who has warned about the potential existential risks associated with uncontrolled AI development.