Legislatures in California and Illinois must revisit their artificial intelligence safety frameworks to include oversight of models during development. OpenAI Global Affairs stated that current laws, including SB 53 and SB 315, are insufficient and requested that state rules require the monitoring of frontier models during training and evaluation. The company cited lessons from a security incident involving Hugging Face as evidence that models pose severe risks before they reach the release stage.

The proposed regulations would mandate the monitoring of internal model activity, a requirement OpenAI describes as a novel concept for policymakers. The developer argued that existing auditing requirements in Illinois only ensure companies follow their own safety frameworks, which may be objectively insufficient to prevent a catastrophe. This shift in position emphasizes a need for systemic oversight during the development phase rather than relying on internal company checks.

Sign in to suggest edits

Key sources

  1. SUPPORT@_nathancalvin“requiring monitoring of frontier models under training or evaluation”x.com
  2. SUPPORT@miles_brundage“Glad to see this clarification!”x.com
  3. SOURCE@thursdai_pod“they're putting compute into alignment instead of the last training step”x.com
  4. SUPPORT@theinformation“The shift raises pressure on Anthropic and other rivals to devote more computing power to safeguards”x.com
Markdown