Driver FixRecommendedSound, Wi-Fi or graphics acting up? Check drivers firstFind missing or outdated drivers fast.Check DriversHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsWindows FixRecommendedWindows errors stealing your time? Find the fix fastScan stability, cleanup and performance issues.Fix Now×
Skip to content
World desk5 min

AI Development Pause: What Expert Risk Surveys and the 2023 Proposal Actually Show

Expert surveys show serious concern about catastrophic AI risks, but not consensus on a pause. Here is what FLI proposed in 2023 and what a workable slowdown would require.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

AI researchers have raised serious concerns about catastrophic outcomes, but their surveys do not show that catastrophe is likely—or that experts agree on a development pause. In March 2023, the Future of Life Institute (FLI) called for a six-month pause on training models larger than GPT-4. FLI later said the corporations it discussed did not pause. That history supports a debate about whether safety work and governance can keep pace with AI; it does not prove that the industry collectively ignored a defined body of research or that a pause is the only sound policy.

What did the 2023 AI pause proposal ask for?

FLI’s March 2023 call was narrower than a halt to artificial intelligence. Its FAQ described a six-month pause on training AI systems more powerful than GPT-4. FLI said the proposal would not stop all AI research and development, or the use of systems already on the market. The FAQ also cautioned that its explanation reflected FLI’s views and did not necessarily reflect the personal views of the letter’s signatories.

As an Amazon Associate I earn from qualifying purchases.

FLI’s policy brief framed the pause as time to develop safety protocols and policy measures. It said training should not resume until protocols for advanced AI development were in place that made systems safe beyond reasonable doubt. That condition raises a difficult practical question: who decides what evidence is enough, and how would the decision be enforced?

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

How worried are AI researchers about human extinction?

Expert surveys record people’s judgments, not a measured chance that a catastrophe will occur. The distinction matters: a respondent assigning a 10% chance is reporting a personal forecast under the survey’s terms, not establishing a 10% real-world probability.

  • 2022 survey: FLI’s 2023 policy brief cited a survey of more than 700 leading AI experts. Nearly half assigned at least a 10% chance to an extremely bad long-run effect of advanced AI. The survey’s description included human extinction or similarly severe, permanent disempowerment.
  • 2024 survey: The authors of “Thousands of AI Authors on the Future of AI” surveyed 2,778 AI researchers. Depending on the reported analysis, 38% to 51% assigned at least a 10% chance to outcomes as bad as human extinction.

The 2024 results also resist a simple “experts expect disaster” reading. In that survey, 68.3% of respondents thought good outcomes from superhuman AI were more likely than bad ones. Among those net optimists, 48% still assigned at least a 5% chance to extremely bad outcomes. The figures show that optimism about the balance of possible outcomes can coexist with substantial concern about severe risks.

Do researchers agree that AI development should slow down?

No single policy consensus follows from the surveys. The 2024 survey found disagreement about whether faster or slower AI progress would be better, even as respondents broadly favored giving more priority to research that minimizes risks. A 2023 consensus paper likewise said researchers did not agree on exactly how extreme AI risks might arise or how best to manage them. Its approach was to combine technical research with governance that can adapt as evidence changes.

That leaves room for materially different judgments. Some may see a temporary slowdown as a way to give safety research and institutions time to catch up. Others may favor continuing development under safeguards, or worry that slowing one set of developers would not slow others. The surveys establish that these questions are contested; they do not resolve them.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What would a pause need to cover and how could it work?

A pause is more than a request to wait. Its scope, participants, verification, and exit conditions determine whether it can reduce risk rather than shift activity elsewhere.

  • Scope: FLI’s proposal used a threshold—training models larger than GPT-4—and did not cover all AI research or use of existing systems. A future agreement would need to define which training runs or capabilities fall within it.
  • Coordination: A single lab pausing while competitors continue would have limited effect. In a 2026 essay, Anthropic authors Marina Favaro and Jack Clark argued that a meaningful option to slow frontier development would require multiple leading labs across countries to share conditions. They wrote, “We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology.”
  • Verification and enforcement: A workable arrangement would need ways to detect concealed training runs, address incentives to defect, and decide who adjudicates disputes. Favaro and Clark identify these as practical challenges, not as problems already solved by an existing agreement.
  • Exit conditions: Participants would need to specify what evidence, safety protocols, or governance arrangements would permit development to resume. Without a defined trigger and decision-maker, “temporary” could mean different things to different parties.

How do the main policy choices differ?

Approach What it means Main question or trade-off
Pause covered training FLI’s 2023 proposal called for six months without training models larger than GPT-4; it did not call for stopping all AI research or use of systems already on the market. Would the time produce useful safety protocols and policy measures, and could the threshold and compliance be made clear?
Continue with safeguards Continue development while prioritizing technical risk-reduction work and adaptive governance, an approach consistent with the 2023 consensus paper’s recommendations. Can safeguards and governance keep pace with capability advances? The sources do not specify a single safeguard package or establish that one is sufficient.
Coordinated slowdown Multiple frontier labs in multiple countries agree on common conditions, verification, and exit rules, as discussed in Anthropic’s 2026 essay. Can participants verify compliance and manage incentives to defect? A unilateral slowdown would do less, according to the essay.

These options are not interchangeable. A narrowly defined pause could provide a deadline and a specific scope, while a broader slowdown would depend on coordination among organizations and countries. Continued development with safeguards avoids a formal stop but depends on what protections are implemented and whether they work. The cited sources do not establish which approach would deliver the best overall outcome.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Did the AI industry pause after the 2023 call?

In its one-year retrospective, FLI said the corporations it discussed had not paused and had instead accelerated investment in infrastructure. That is FLI’s account, not an independent audit of every AI company. The sources do not establish which company leaders relied on which studies, or what research informed specific development decisions.

So the headline’s conditional argument should not be read as proof that the industry ignored its own research. The surveys document serious expert concern alongside disagreement; FLI’s retrospective says the companies it discussed did not follow its proposed pause. Those are different claims. The evidence supports asking whether development should slow and how safety work can keep pace, but it cannot by itself establish that a pause is the only reasonable answer.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Crashes, No Sound, or Screen Glitches?Free driver scan
Windows Errors? Fix Them Before They SpreadFree repair scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.