Halloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsWindows FixRecommendedWindows errors stealing your time? Find the fix fastScan stability, cleanup and performance issues.Fix NowHalloween DealsAmazon USOctober picks are moving - compare before checkoutAmazon US: current deals, useful picks and tech finds.See Picks×
FREEDOM251

Freedom251 › Blog › AI Regulation

AI Doomsday Warnings: Who Gains Power—and Who Sets the Safety Rules?

By Freedom251 Team · · 7 min read

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

AI doomsday warnings can make the companies building powerful systems more central to debates over how those systems are governed—but the available evidence does not establish that the rhetoric itself has caused a measurable increase in corporate power. The concern is about a plausible political mechanism: when firms help define the risks, propose the standards and supply the evaluators, they can gain influence over rules intended to oversee them. That question is separate from whether AI poses serious risks, including catastrophic ones.

Does AI doomsday talk make tech companies more powerful?

It may help concentrate influence, but the causal claim needs care. The sources available document risk arguments, proposed governance arrangements, market concentration and analysts’ interpretations of corporate messaging. They do not measure how much doomsday rhetoric has increased corporate power, or show that it caused a specific policy outcome.

As an Amazon Associate I earn from qualifying purchases.

The mechanism worth examining is who gets to act when catastrophic risk becomes the dominant frame. Frontier AI companies possess technical expertise, system access and resources that governments and outside researchers may lack. If policy relies heavily on those firms to identify hazards, set standards or assess compliance, their role can expand from builder to rule-shaper and evaluator. That can occur even when their warnings are sincere and the risks are real.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The Associated Press reported in 2026 that some analysts interpret calls by major labs for a slowdown and oversight as positioning those firms as safer market leaders or creating a barrier for smaller competitors. PitchBook analyst Harrison Rolfes described this as “a wall or a moat within this sector”; that is his assessment reported by AP, not evidence of company intent. The same report included researchers who fear that AI capabilities could outpace companies’ ability to control them, as well as company representatives who said they had sought regulation or paused work. The AP account therefore captures a contested interpretation, not a settled explanation of why any company supports oversight.

Who gets to decide what counts as AI safety?

That depends not just on the language of risk but on the institutional design behind it: who writes the rules, who checks compliance, and who can see the evidence. A safety plan can promise rigorous monitoring yet still leave important choices with the companies being monitored.

Embedded monitors and company-led standards

Brookings examines a proposal associated with Anthropic CEO Dario Amodei that includes safety monitors embedded in frontier labs, shared standards among AI companies in democratic countries, and coordination with authoritarian governments. Brookings notes that the proposal does not specify that embedded evaluators must be independent, and that Amodei called for an antitrust waiver for some safety discussions. Its authors argue that putting developers in charge of oversight risks entrenching company control. That is a criticism of the proposal’s governance design, not proof that the proposal or its proponents acted in bad faith. Brookings’ analysis is one view in an active debate.

Evaluation access is central to the issue. An evaluator who cannot inspect a system adequately may be unable to identify important failures; an evaluator whose access or appointment depends on the company may also face questions about independence. Former U.S. Center for AI Standards and Innovation leader Conrad Stosz, quoted by AP, asked whether evaluators could investigate thoroughly while preserving their independence and credibility. The question is not whether every company-selected evaluator is compromised, but whether the arrangement gives evaluators sufficient authority and protected access to earn public trust.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Why do safety debates sometimes overlook harms happening now?

Pre-deployment testing for severe or catastrophic capabilities addresses one class of risk. It does not replace observation of systems after release, when people use them in workplaces, public services and consumer products. Research attention can be uneven across those stages.

A Social Science Research Council working paper by Ilan Strauss, Isobel Moure, Tim O’Reilly and Sruly Rosenblat reviewed 1,178 safety and reliability papers from 9,439 generative AI papers published between January 2020 and March 2025. Comparing research from five major AI companies with work from six universities, the authors report increasing corporate focus on pre-deployment alignment and testing, alongside declining attention to deployment-stage topics such as bias. They identify gaps involving healthcare, commercial and financial settings, misinformation, persuasive or addictive features, hallucinations, and copyright in training and inference. These are the authors’ findings from the paper set they reviewed, not a complete census of AI research. They recommend greater outside-researcher access to deployment data and systematic observation of systems in use. Read the SSRC working paper.

The distinction matters because a system can pass pre-release tests and still cause harms through how it is deployed, who relies on it, or how it is integrated into a decision process. UC Berkeley Risk & Security Lab fellow Sarah Shoker told AP that existential-risk discussion can push present safety concerns aside, pointing specifically to AI use in military technology. Her observation does not disprove catastrophic risks; it argues for keeping current harms visible alongside them.

How does concentration extend beyond the AI model?

Influence in AI does not sit only with the firms training prominent models. A Yale Law & Policy Review analysis maps the supply chain across microprocessing hardware, cloud computing, algorithmic models and applications. Its authors argue that some layers are monopolistic or oligopolistic, and that concentration can distort markets, deter investment, hinder innovation and accumulate private power. They propose antimonopoly tools, network and utility regulation, industrial policy, public options and cooperative governance. These are the article’s analysis and recommendations, not an uncontested policy consensus. The Yale Law & Policy Review article explains the framework.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The World Economic Forum’s 2024 Global Risks Report likewise warns that the globally integrated AI supply chain favors a small number of companies and countries. It flags dependence on a limited number of foundation models or a single cloud provider as a potential source of systemic cyber vulnerability, particularly for finance and the public sector. Its wider list of AI risks includes misinformation, job displacement, criminal misuse and cyberattacks, bias, consequential decisions and warfare. The report’s AI risk discussion places market structure alongside, rather than in place of, safety concerns.

Two Brookings figures help describe the wider concentration and representation problem, but neither is an AI market-share measure: 100 companies accounted for 40% of global corporate research and development spending in 2022, and 118 countries—mostly in the Global South—were absent from major AI-governance initiatives. Those statistics concern corporate R&D and participation in governance, respectively. They should not be read as estimates of how much of the AI market any company controls.

Can AI regulation be captured by the companies it oversees?

Regulatory capture is a vulnerability to investigate, not a finding to assume. A 2025 article in AI & SOCIETY defines AI safety regulatory capture as rules presented as protecting the public that in practice primarily protect dominant firms and shareholders, at the expense of smaller firms or the public. It describes several mechanisms that could increase the risk:

  • High entry barriers: compliance requirements may be easier for established firms with substantial resources to meet than for smaller entrants.
  • Technical complexity and information gaps: regulators may depend on developers to explain systems they cannot inspect or assess independently.
  • Economic dependence: direct reliance on industry resources or expertise can narrow regulators’ practical options.
  • Personnel movement: movement between agencies and industry can create conflicts or weaken the appearance of independence if safeguards are inadequate.

The article is partly theoretical and normative, and it explicitly notes that capture cannot straightforwardly be measured in a young industry. These mechanisms are warning signs for governance design, not evidence that a particular regulator has been captured. The 2025 article sets out its framework.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

What would more accountable AI safety governance look like?

No single safeguard resolves every risk. The approaches below distinguish governance choices that are often blurred together; they are comparison points, not a ranking of proven policy effectiveness.

Decision area Narrower arrangement Accountability question
Who sets and enforces rules Voluntary company commitments or industry standards Are there binding public rules, an enforcement authority and consequences for noncompliance?
Who evaluates systems Company-selected or embedded evaluators Do independent evaluators have protected access, clear authority and safeguards for credibility?
What evidence is visible Disclosure chosen by each company Can standardized reporting and outside access reveal harms across developers rather than only what firms choose to publish?
Which risks receive attention Pre-deployment testing for catastrophic capabilities Are systems also monitored in use for bias, misinformation, surveillance, misuse and other deployment harms?
How market structure is addressed Safety obligations alone Are safety rules considered alongside competition policy and measures that broaden access?

Brookings argues for mandatory, standardized reporting at a defined threshold so officials can track harms and vulnerabilities across developers. Such reporting could make company disclosures more comparable, but it would not by itself provide every evaluator with the access needed to verify claims. The SSRC authors’ call for outside researcher access to deployment data addresses a related, distinct gap: observing how systems behave in the world, not only what developers report about them.

The practical test for any safety proposal is therefore institutional: does it give public authorities and independent evaluators enough information, access and authority to challenge the firms whose systems they assess? Serious risk warrants serious oversight. It does not, on its own, determine that oversight should be designed or controlled by the companies subject to it.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

AI RegulationAI SafetyArtificial Intelligencemarket concentrationtechnology policy

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Crashes, No Sound, or Screen Glitches?Free driver scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.