The AI Safety Menu

All laws

EU AI Act

EU AI Act, systemic-risk models. Article 55 plus the Code of Practice: evaluations, external evaluators, incident reporting, cybersecurity, and a model report before market.

Grows lead by~1 dayof America's lead over China, over 3 years
Cuts p(doom) by~0.66%from a 5% starting estimate
Holds up○ Training○ Lab's own use● Public release
Enact it on the menuSee the findings

What it does

Europe's rules for the most powerful models, enforceable since August 2026. Labs must test for serious risks, give outside testers time with the model, report incidents, and file a report before release.

Applies to: General-purpose AI models above 10^25 FLOP or designated by the Commission.

What's in it: Safety plan, Safety tests, Outside safety tests, 4-week test period, Transparency report, Incident reports, Lock up the weights

Where things stand

Anthropic, OpenAI, Google, Amazon and Microsoft signed the full Code; xAI signed the safety chapter; Meta did not sign. GovAI found no model release delayed or withheld from the EU in the first five months of 2026, before fines applied. The obligations are now enforceable and it is too early to see their effect.

Why it gains ~1 day

Its testing and paperwork cost under a day of U.S. progress, and its security rules make theft slightly harder. On net it slightly widens the lead.

Biggest unknown: How strictly the AI Office reads the 20-business-day evaluation period and the pre-market Model Report once fines apply.

Why it lowers p(doom) by ~0.66%

Europe's rules: testing, outside evaluators, incident reports and security for the most powerful models.

The strongest case that it costs more

Fines only became enforceable on August 2, 2026, so the no-delays finding covers a period when the Code was voluntary. A regulator that treats "at least 20 business days" as a floor and the Model Report as a hard gate has a five-week release delay in its hands, and the AI Office can demand model access for its own evaluation on top. If labs do not want to ship the U.S. first and the EU five weeks later, the whole delay lands on the global release.

The debate

For

Against

Sources

Rough starting points, not precise forecasts. Lead costs assume China doesn't depend on U.S. models, the case least favorable to safety laws, and count 3 years. On the menu you can change every assumption and put in your own numbers. Last priced 2026-09-26.