Former Anthropic researcher Jacob Coxon has resigned from the AI company, claiming leading AI firms are moving too quickly toward superintelligence without adequate safeguards.
Coxon, who previously worked on AI research at both Anthropic and OpenAI, said the industry is “racing straight to self-improving superintelligence” and warned that developers are taking significant risks. His comments have reignited debate over the safety of increasingly powerful AI systems.
Anthropic Alignment Science Lead Evan Hubinger responded by acknowledging that while the company is working on AI safety, it does not yet have a clear solution for aligning future superintelligent systems with human goals.
Coxon’s departure comes amid growing concern within the AI community. In July, more than 1,300 employees from frontier AI companies signed a statement warning that AI capabilities could advance faster than humanity’s ability to understand or control them. The group called for international efforts to develop tools that can deliberately slow the pace of advanced AI development when necessaryEx-Anthropic Researcher Warns of AI Risks After Resignation
Former Anthropic researcher Jacob Coxon has resigned from the AI company, claiming leading AI firms are moving too quickly toward superintelligence without adequate safeguards.
Coxon, who previously worked on AI research at both Anthropic and OpenAI, said the industry is “racing straight to self-improving superintelligence” and warned that developers are taking significant risks. His comments have reignited debate over the safety of increasingly powerful AI systems.
Anthropic Alignment Science Lead Evan Hubinger responded by acknowledging that while the company is working on AI safety, it does not yet have a clear solution for aligning future superintelligent systems with human goals.
Coxon’s departure comes amid growing concern within the AI community. In July, more than 1,300 employees from frontier AI companies signed a statement warning that AI capabilities could advance faster than humanity’s ability to understand or control them. The group called for international efforts to develop tools that can deliberately slow the pace of advanced AI development when necessary
Both Anthropic and OpenAI have previously indicated that future mechanisms may be needed to manage the speed of AI progress as the technology becomes increasingly powerful.
+ There are no comments
Add yours