Sanders to Introduce Superintelligence Ban After Anthropic Warning of 10% Extinction Risk
Regulation22d agoSenator Bernie Sanders is drafting a legislative package to halt the development of autonomous AI systems after internal alarms at top labs. The proposal will ban the creation of superintelligence and pause current development, following the resignation of Jacob Coxon, a pretraining researcher who spent three years at both OpenAI and Anthropic, who warned that the companies are racing toward self-improving systems they cannot control.
Evan Hubinger, Anthropic’s alignment science lead, states there is a greater than 10% chance that AI will kill all humans within the next 10 years. Hill Democrats are urging Congress to act, as Coxon claims that labs are gambling with human lives by pursuing a "hubristic" endgame through private corporate channels without coordinated safety restraints.
Key sources
- SOURCE@berniesanders“The very people building this technology admit that it could threaten the future of humanity”x.com
- SUPPORT@politico“Lawmakers urge Congress to act after AI researcher’s dire warning”x.com
- SUPPORT@punchbowlnews“chance the models could threaten humanity in a few short years”x.com
- SOURCE@krystalball“Alignment science lead at Anthropic”x.com
- SUPPORT@yashar“Anthropic still does not have a plan to solve the problem”x.com
- SUPPORT@johnschulman2“industry leaders OpenAI and Anthropic to stop feuding and work on a pacing proposal together”x.com
- SOURCE@axios“Sanders convenes senators for AI briefing amid mounting alarm”x.com
- SUPPORT@geoffreyhinton“spent the last three years doing pretraining research at both OpenAI and Anthropic”x.com