Technology7 min read

The AI Regulation War Is Just Getting Started

AI regulation is back at the center of tech policy. Explore Dario Amodei's three-step oversight plan and what the AI governance battle means for the future.

The AI Regulation War Is Just Getting Started

Key takeaways

  1. 1That law covers roughly 450 million people and carries fines of up to 35 million euros or 7 percent of global annual turnover for the most serious violations.
  2. 2The 1968 Nuclear Non-Proliferation Treaty took decades to negotiate and remains imperfectly enforced.
  3. 3A 2023 survey by the AI Policy Institute found that 82 percent of Americans support government regulation of AI — a figure that has remained stable across partisan lines in subsequent polling.
  4. 4The Road Ahead: Global Stakes and Unresolved Tensions The regulatory battle unfolding in 2026 is not a temporary flare-up.
Sections · 6

The AI Regulation Debate Heats Up in 2026

Three years after the United States issued its sweeping Executive Order on Artificial Intelligence in October 2023 — the most ambitious federal attempt to govern AI development in American history — the question of who controls the technology's trajectory remains deeply unsettled. The European Union's AI Act, which began phasing in requirements for high-risk systems in 2024, offered one model: a risk-tiered framework that classifies AI applications from minimal to unacceptable risk, with corresponding obligations for developers. That law covers roughly 450 million people and carries fines of up to 35 million euros or 7 percent of global annual turnover for the most serious violations.

Yet for all that legislative activity, the fundamental debate — how much should governments constrain the pace and shape of AI development — has not been resolved. If anything, it is intensifying. The latest inflection point came when Anthropic CEO Dario Amodei broke from the tech industry's reflexive skepticism of government oversight and publicly backed a structured framework for slowing AI development. For a moment, it seemed the most powerful voices in the field had found tentative common ground. That moment did not last.

Dario Amodei's Three-Step Plan for Slowing AI Development

Amodei's proposal is notable both for its ambition and for where it comes from. Anthropic sits at the forefront of frontier AI research; the company was founded on the premise that advanced AI poses genuine existential risks. That background gives Amodei's policy arguments a particular weight — he is not a regulator warning about an industry he doesn't understand. He is an insider calling for constraints on his own work.

Read next Laika's Wildwood: Stop-Motion Fantasy at TIFF 2026

His three-step plan addresses the problem at multiple levels simultaneously. First, it calls for embedding third-party evaluators directly inside AI laboratories — not auditors who review outputs after the fact, but independent technical experts who observe development as it happens. Second, it proposes coordinating across the domestic AI industry, meaning America's leading labs would operate under shared safety standards rather than racing independently with minimal oversight. Third, it envisions international agreements that extend those constraints globally, preventing a race-to-the-bottom dynamic in which less-regulated jurisdictions attract development that other countries have deemed too risky.

The scope of that third step alone signals how seriously Amodei takes the problem. Negotiating binding international frameworks for emerging technologies is extraordinarily difficult. The 1968 Nuclear Non-Proliferation Treaty took decades to negotiate and remains imperfectly enforced. AI development is faster-moving, more diffuse, and harder to verify than nuclear programs. Getting a dozen sovereign nations to agree on what constitutes "dangerous AI" — and to enforce those definitions consistently — requires a level of diplomatic coordination rarely achieved outside of climate agreements, and sometimes not even there.

Why AI Leaders Are Now Embracing Oversight

The shift in sentiment among AI developers did not happen in a vacuum. A 2023 survey by the AI Policy Institute found that 82 percent of Americans support government regulation of AI — a figure that has remained stable across partisan lines in subsequent polling. That public pressure creates a political environment in which total opposition to oversight is increasingly untenable for companies that depend on public trust.

There is also a strategic dimension. Larger, more established AI labs stand to benefit from regulation that raises compliance costs across the industry. If oversight requirements are substantial, smaller competitors face proportionally greater burdens. The history of pharmaceutical and financial regulation includes examples of incumbent firms quietly supporting rules that cemented their market positions. Critics of voluntary safety commitments from AI companies have made exactly this argument — that self-regulation serves incumbents more than the public.

But reductive cynicism misses something real. The researchers who founded Anthropic left OpenAI specifically because of concerns about safety practices. The UK AI Safety Institute, established in 2023, has conducted technical evaluations of frontier models and found genuine capability gaps between what developers understood about their systems and what independent testing revealed. RAND Corporation policy researchers studying AI governance have similarly noted that self-assessment by developers produces systematically optimistic results. The push for external oversight reflects a genuine epistemic problem: the organizations building the most powerful AI systems have strong incentives — financial, reputational, and sometimes ideological — to underestimate the risks those systems pose.

The Opposition: Who Is Pushing Back and Why

The apparent consensus around AI regulation did not survive long. Pushback came quickly, and it came from multiple directions.

Some opposition is nakedly economic. The AI industry represents one of the most significant concentrations of investment capital in recent history, with global AI investment exceeding $100 billion annually by some estimates. Any framework that slows development or imposes compliance costs threatens returns on that capital. The lobbying infrastructure around this interest is substantial and well-funded.

Other objections are more principled. Some technologists and economists argue that the risks of over-regulation — stifled innovation, ceded competitive advantage to less scrupulous foreign developers, delayed benefits from medical AI and climate modeling — outweigh the risks of under-regulation. This argument has real force. AI applications in drug discovery have already compressed timelines for identifying promising compounds from years to months. Regulatory delay is not cost-free.

There is also a geopolitical argument that resists easy dismissal. If the United States imposes strict AI development constraints while China does not, the result may be a world in which the most powerful AI systems are built under fewer safety constraints, not more. The answer to this concern, as Amodei's proposal recognizes, is international coordination — but that is precisely what is hardest to achieve.

What Effective AI Regulation Could Actually Look Like

The idea of embedding third-party evaluators inside AI labs sounds straightforward. It is not. The technical complexity is significant and underappreciated in most policy discussions.

Evaluating a frontier AI system requires understanding not just what it produces, but why. Current large language models involve billions of parameters whose interactions produce emergent behaviors that neither their creators nor external auditors can fully predict or explain. A third-party evaluator observing training runs would need deep technical expertise simply to know what to look for — and the field of interpretability research, which tries to understand how AI systems process information internally, remains in its early stages. The UK AI Safety Institute's evaluations have relied on structured red-teaming and capability elicitation techniques that are genuinely novel and not yet standardized.

This is not an argument against third-party audits. It is an argument for investing heavily in making them technically meaningful rather than procedurally empty. Regulation that requires audits without ensuring auditors have the tools and expertise to conduct them produces compliance theater — the appearance of oversight without the substance.

The EU AI Act's risk-tiered approach offers one structural model: concentrate regulatory burden where harm potential is highest, allow lighter oversight elsewhere. Policy scholars at institutions like the Georgetown Center for Security and Emerging Technology have argued for adaptive regulation that evolves alongside the technology, rather than static rules written against the capabilities of 2024 systems.

The Road Ahead: Global Stakes and Unresolved Tensions

The regulatory battle unfolding in 2026 is not a temporary flare-up. It is the beginning of a sustained, multi-decade contest over who governs transformative technology — and on whose terms.

The stakes extend well beyond any individual company's competitive position. If AI systems grow significantly more capable in the next five years, the governance frameworks established now will shape what kinds of applications get built, who benefits from them, and who bears the costs when they fail. History suggests that getting those frameworks right at the beginning is far easier than reforming them once powerful interests have organized around the status quo.

Amodei's three-step plan may not survive political negotiation intact. Some elements will be diluted; others may prove technically unworkable. But the underlying instinct — that the organizations building frontier AI cannot be trusted to govern themselves, and that international coordination is necessary to prevent a regulatory race to the bottom — reflects a clear-eyed reading of how technology governance has failed before. The AI regulation debate is not nearly over. It has barely started.


Source: The Verge

Published

29 September 2026

Author

Editorial

Comments

No comments yet. Be the first.

Leave a comment