--- format: "aidr-story-markdown/v1" id: "d5db6ce3c6fc2004f753baeb6a352625313d53bc03a17917922bd6aed38cc535" canonical_url: "https://aidr.today/d5db6ce3?lang=en" title: "Anthropic Lead Sees 10% Human Extinction Risk After Researcher Quits Safety Lab" lang: "en" requested_lang: "en" available_langs: ["en","vi"] translation_fallback: null fallback_fields: [] published_at: "2026-09-09T05:45:46.000Z" category: null topics: ["anthropic","safety","reasoning","openai","regulation","infra","chips","agent"] source_urls: ["https://huggingnews.com/ai/anthropic-lead-sees-10percent-human-extinction-risk-after-researcher-qui-72e02af2","https://x.com/WSJ/status/2097474365163999402","https://x.com/_NathanCalvin/status/2097477731818537273","https://x.com/wallstengine/status/2097473010001391983","https://x.com/krystalball/status/2097506892763234581","https://x.com/yashar/status/2097542341670359082","https://x.com/johnschulman2/status/2097548011408961776","https://x.com/peterwildeford/status/2097475721170206729"] summary: "Jacob Coxon left his position at Anthropic and the broader artificial intelligence field after three years of pretraining work at the company and OpenAI. He warned that competing labs are making safety trade-offs to win a race toward self-improving superintelligence that could spiral out of control by the end of next year, rendering any individual lab's efforts to build safely ineffective. Evan Hubinger, Anthropic's alignment science lead, estimates a greater than 10% chance that AI kills all humans within the next decade. Hubinger said the company does not yet have a plan to solve the alignment problem for superintelligence, even as the firm prepares for a potential IPO and researchers inside the lab use terms like \"crunchtime\" to describe the pace of capabilities." --- # Anthropic Lead Sees 10% Human Extinction Risk After Researcher Quits Safety Lab > [Open the canonical story]() **Published:** 2026-09-09T05:45:46.000Z **Topics:** anthropic, safety, reasoning, openai, regulation, infra, chips, agent ## Summary Jacob Coxon left his position at Anthropic and the broader artificial intelligence field after three years of pretraining work at the company and OpenAI\. He warned that competing labs are making safety trade\-offs to win a race toward self\-improving superintelligence that could spiral out of control by the end of next year, rendering any individual lab's efforts to build safely ineffective\. Evan Hubinger, Anthropic's alignment science lead, estimates a greater than 10% chance that AI kills all humans within the next decade\. Hubinger said the company does not yet have a plan to solve the alignment problem for superintelligence, even as the firm prepares for a potential IPO and researchers inside the lab use terms like "crunchtime" to describe the pace of capabilities\. ## Sources - [Story source]() - [Story source]() - [Story source]() - [Supporting source]() - [Story source]() - [Supporting source]() - [Supporting source]() - [Supporting source]()