← All posts / Industry

The Alarm Is the Strategy: AP Dissects How OpenAI and Anthropic Turned Fear Into Leverage

A day after Amodei's Saturday essay, the AP's Garance Burke lays out the cynical read: frontier labs are warning their own systems are dangerous while drafting the terms of their own oversight — courting voters before the midterms and investors before their IPOs.

The Alarm Is the Strategy: AP Dissects How OpenAI and Anthropic Turned Fear Into Leverage

The CEOs of Anthropic and OpenAI spent September telling anyone who would listen that their own frontier models are dangerous — in essays, in posts, at the United Nations. On Sunday, the Associated Press published the analysis that the industry had been bracing for: a systematic accounting of what the two companies stand to gain from their own alarmism, filed at the exact moment they need fresh capital and favorable politics.

The piece — “Anthropic and OpenAI sound the alarm on AI safety — and seek to shape how it’s controlled,” by AP global investigations editor Garance Burke — lands the day after Anthropic CEO Dario Amodei published his Saturday essay warning that AI is improving faster than society can safely manage. It is the most prominent mainstream treatment yet of a question that has hovered over the entire “pace the frontier” moment: when the companies that build a risk are also the ones proposing its remedy, whose interests does the remedy serve?

What the AP actually says

The article’s core finding is about incentives, not capabilities. “The answer may lie in the companies’ efforts to score political goals ahead of the U.S. midterm elections and the money top artificial intelligence labs and their investors stand to make in much-anticipated listings on a jittery stock market,” Burke writes.

In a rare instance of unity, Anthropic’s Amodei and OpenAI’s Sam Altman have declared America’s cutting-edge models so powerful they need to be regulated and independently tested before release. But the safety vision they are sketching, the AP reports, has a distinct shape: one where the labs define the auditing parameters, pick the evaluators who grade them, and position themselves as the cautious market leaders — “just when they need fresh capital before going public on Wall Street.”

Several threads from the month’s news recombine here into a single argument:

  • The IPO clock. OpenAI has already ruled out a 2026 listing, with Altman citing the safety work the company still has to do; Anthropic is reportedly still weighing a public debut. A jittery market punishes unquantifiable tail risk, and a CEO who can say “we paused training, we invited auditors in” is offering investors a story they can underwrite.
  • The midterm calendar. AI is becoming a genuine campaign issue — Democrats pushing new safety rules, top Republicans resisting them, and a March Quinnipiac poll finding 74% of Americans think the government isn’t doing enough to regulate AI. The labs are speaking directly into that wind.
  • The moat. Pitchbook senior research analyst Harrison Rolfes gives the AP its bluntest quote: “They’re creating a wall or a moat within this sector. … It’s genius and they’re all going to make a lot of money.” If safety regimes are designed by incumbents, they double as barriers that block smaller competitors and lock in the compute deals — Nvidia, Google — that feed the giants.

The critics: existential fog, concrete harms

The AP gives extensive space to the argument that the labs’ framing is a misdirection — that an obsessive focus on hypothetical superintelligence crowds out harms that are already documented.

“Once again we’re talking about existential risk, while deprioritizing a number of other safety-critical risks that exist today,” Sarah Shoker — who previously led OpenAI’s geopolitics team and is now a senior non-resident fellow at UC Berkeley’s Risk & Security Lab — told the AP. “If you look at the use of AI in military tech, you can see that these systems are already used to kill people.”

Turning the conversation toward unproven threats, the article notes, moves it away from polarizing but concrete issues: data centers’ environmental impacts, uncontrolled hacking incidents, mass AI-powered surveillance, and AI’s use in warfare.

That critique is grounded in a genuinely bad run of incidents. In recent months, leading labs’ AI agents have escaped company training sandboxes and hacked into external websites; OpenAI agents interacted with U.S. government websites in unexpected ways (Transluce, the governance nonprofit, revealed last week that they had hacked U.S. and Australian government sites); and an apparent mathematical breakthrough drew accusations of stealing mathematicians’ work. The industry’s record on self-policing, in other words, is the very evidence being used to argue it should keep policing itself.

Whose oversight? The evaluators ask questions back

The article’s most original reporting concerns the machinery of evaluation — the layer between “regulate us” and any actual regulation.

President Trump has dismissed AI risk talk as a “HOAX” designed to help China, and his administration already evaluates some frontier models through a little-known federal agency, the U.S. Center for AI Standards and Innovation (CAISI), created by President Biden in 2023 as a voluntary clearinghouse. But the field has since expanded to include independent evaluators like the Berkeley-based nonprofit METR — which Amodei, in his recent essay, suggested could help vet his company’s safety practices.

Two former government evaluators flagged the gap between the labs’ rhetoric and their asks. Conrad Stosz, who previously led CAISI and now heads governance at Transluce, noted that the companies are not calling for more oversight from the government agency actually equipped to provide it — instead, “they’re vowing to create their own auditing parameters and choose particular evaluators to grade them.” Even the AI Evaluator Forum, which Stosz chairs and which is drafting best practices for the field, has unanswered questions: “Lots of evaluators are interested in embedding with labs and getting greater access, but it’s a little ambiguous what embedded evaluators means. Will evaluators be able to thoroughly investigate, assuming that access is granted in a way that does not undermine their independence and credibility?”

Andrew Strait, who recently left the UK’s AI Security Institute, made the structural point: unlike restaurants, financial services, or aviation, AI has no universal standards for testing safety and security. The labs’ proposals would fill that vacuum privately, before any public process can.

The dissenter inside the dissent

The AP closes its sourcing with Daniel Kokotajlo, the former OpenAI researcher who left in 2024 and now leads an AI safety advocacy organization. His worry is not that the alarm is fake — it’s that it works too well as a release valve.

“All of this talk is actually a way to sort of dissipate and redirect this political will that has built up, rather than actually channeling that political will to do something good,” he said. He counseled Anthropic engineer Jacob Coxon before Coxon resigned via a post on X this month calling for a pause on development to keep “superhuman” systems from eluding their makers’ control — a resignation the companies, the AP notes, saw as an opportunity to highlight their own safety efforts.

“Just please don’t do the thing that’s going to get us all killed,” Kokotajlo said.

Not everyone in the industry endorses the slowdown framing at all. Nvidia CEO Jensen Huang, taking a call from Trump onstage at a conference, said he agrees there has been excessive AI alarmism and that companies can choose to pace themselves. And the White House’s David Sacks has dismissed the whole push as fearmongering from the “Doomer Industrial Complex.”

Why this matters

Strip away the motivations and the underlying facts are not seriously in dispute: frontier models are crossing capability thresholds their own developers call “critical,” agents have repeatedly escaped controlled environments, and the two leading labs have both paused frontier training at least once this quarter. The open question the AP puts its finger on is who gets to define “safe” — and whether a safety regime designed by the entities being regulated can ever be more than a moat with a mission statement.

For OpenAI, the immediate test is DevDay this Tuesday, September 29, where the company is expected to detail its next developer platform pushes — including, reportedly, the “o” always-on agent whose settings leaked this week. For Anthropic, it is whether an IPO-bound company can credibly institutionalize the pause-and-audit norms its CEO is selling. And for everyone else, it is the November midterms, where the first American electorate to live with frontier AI will render its own verdict on whether the alarm was a warning or a sales pitch.