AI & Machine Learning
Business Insider10 days ago
5

Anthropic says frontier AI labs may need to slow down so society can catch up

AI

Anthropic calls for a coordinated slowdown in frontier AI development to allow society and safety research to catch up with rapid advancements.

Anthropic says frontier AI labs may need to slow down so society can catch up

Intelligence Insights

Context + impact, normalized for TechCulture.

The Big Picture
Anthropic published a blog post arguing that frontier AI labs may need to slow down development to give society time to adapt and for alignment research to progress. The company noted that AI is accelerating its own development, with over 80% of code at Anthropic now written by its AI model Claude, and engineers merging eight times more code daily than in 2024. While not calling for an immediate pause, Anthropic emphasized that any slowdown would require coordination among multiple AI developers and governments, as unilateral action would be ineffective. The warning comes amid widespread AI adoption in coding, recruiting, and customer service, with companies like Google reporting 75% of code generated by AI and others linking layoffs to AI efficiency gains. Anthropic stressed that building the necessary infrastructure and trust for such coordination takes time, and 'we don't have that long.'
Why It Matters
Anthropic's call for a coordinated AI slowdown signals that even leading developers fear the technology is outpacing society's ability to manage its risks. With AI now writing most code at companies like Google and Anthropic, and driving layoffs across industries, the debate shifts from capability to control—raising urgent questions about regulation, job displacement, and the need for alignment research to catch up before AI becomes self-improving.

Deepen your understanding

Use our AI to break down complex signals.

Select an AI action to generate more depth.

Dario Amodei
Dario Amodei
Anthropic's CEO Dario Amodei.

Bloomberg/Getty Images

  • Frontier AI labs are advancing systems at a hard-to-follow speed.
  • So much so that Anthropic has called for a coordinated slowdown in AI development.
  • "It would be good for the world to have the option to slow," the company said in a blog post.

Anthropic says AI is advancing so fast that leading labs may need to slow down.

In a blog post published Thursday, researchers at The Anthropic Institute, the company's research arm, said that AI is already speeding up the development of new AI models so quickly it could eventually help build its own successors.

"We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology," the company said.

Anthropic's warning comes as AI is reshaping the tech industry and the broader economy at breakneck speed.

In recent months, executives have touted AI's growing ability to perform work once done by humans, from writing software code to handling recruiting and customer service tasks. Google has said AI now generates 75% of its code, while Mercor CEO Brendan Foody recently said that his startup spends more on AI tokens than employee salaries.

At the same time, a growing list of companies has linked layoffs and restructurings to AI-driven efficiency gains.

Anthropic pointed to its own internal data, showing how much work is already being delegated to AI.

It said that more than 80% of the code merged into its codebase is now written by Claude, and that the typical engineer was merging eight times as much code per day in the second quarter of 2026 as in 2024.

While one employee cited in the blog post said there are days when everything goes so well they "can't help but think nothing I do matters," another said it had been roughly five months since they last wrote any code themselves.

The report also said AI systems are increasingly capable of handling engineering and research work that once required humans.

While current models still struggle with higher-level judgment and deciding which problems are worth solving, the company said AI capabilities are advancing rapidly.

Anthropic stopped short of calling for an immediate pause.

However, it said that any meaningful slowdown would require coordination among multiple frontier AI developers and governments, warning that a unilateral pause by a single company would do little to improve safety.

While similar arrangements have existed for other powerful technologies, the company warned that building the infrastructure and trust required for them takes time.

"We don't have that long," it said.

Read the original article on Business Insider
Big Tech AI Policy

Intelligence Exchange

0

Log in to participate in the exchange.

Sign In

Syncing Discussions...

Finding Related Intelligence...