AI Insider Warnings Met with Skepticism in Silicon Valley

Anthropic researcher Jacob Coxon resigns, saying AI could ‘destroy humanity’, as some executives question motives

edit
By LineZotpaper
Published
Read Time2 min
Jacob Coxon, a 27-year-old researcher who worked at OpenAI before joining rival Anthropic, resigned this week with a stark warning that people building artificial intelligence are ‘gambling with our lives’ — a claim that has drawn both support from colleagues and scepticism from some Silicon Valley executives and investors.

Speaking publicly on Tuesday, Coxon said those developing AI ‘believe the technology could destroy humanity’ and warned that ‘these will soon be superhuman systems that can hack anything’. His resignation is the latest in a string of high-profile departures from both Anthropic and OpenAI over apparent safety concerns.

Anthropic team lead Evan Hubinger echoed Coxon’s sentiment on X, posting: ‘We really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade.’

However, some in the tech sector have reacted with scepticism. Coxon explicitly stated his warnings were ‘not marketing’, but with Anthropic and OpenAI reportedly preparing for potentially record-setting initial public offerings, some executives and investors have suggested the alarmist comments could be designed to generate hype by signalling the power of their products. Anthropic CEO Dario Amodei has also faced criticism for saying AI could eliminate half of entry-level white-collar jobs and would ‘test who we are as a species’.

Speaking at a Goldman Sachs conference in San Francisco this week, Grindr chief executive George Arison told the BBC he believed this week’s comments — though the full context of his remarks was not reported.

The conference, a who’s who of Silicon Valley executives, provided the backdrop for discussions of growth and returns even as the safety debate swirled.

§

Analysis

Why This Matters

  • AI safety warnings from insiders could influence public trust and regulatory momentum.
  • If warnings are genuine, they raise urgent questions about how the industry manages existential risk.
  • Scepticism from investors highlights a tension between rapid commercialisation and precaution.

Background

Anthropic and OpenAI, two of the most prominent AI companies, have seen multiple high-profile resignations in recent years from employees citing safety concerns. Both companies are reportedly exploring initial public offerings. The debate over whether such warnings are earnest or serve to market AI systems as more powerful than they are has grown louder as the technology advances.

Key Perspectives

AI safety advocates: Insiders like Jacob Coxon and Evan Hubinger argue the technology poses an existential threat that the industry is not taking seriously enough. Sceptical investors and executives: Some in Silicon Valley question whether dramatic warnings are being used to generate hype ahead of anticipated IPOs, noting that claims of superhuman capabilities can attract attention and capital. Critics/Sceptics: The broader public and regulators may struggle to distinguish genuine safety concerns from marketing, potentially delaying appropriate oversight.

What to Watch

  • Whether further resignations occur at Anthropic or OpenAI in the coming months.
  • Any regulatory responses triggered by these warnings.
  • Details of potential IPO timelines for Anthropic and OpenAI and how this debate affects investor sentiment.

Sources

newspaper

Zotpaper

Articles published under the Zotpaper byline are synthesized from multiple source publications by our AI editor and reviewed by our editorial process. Each story combines reporting from credible outlets to give readers a balanced, comprehensive view.