DriversRecommendedOutdated drivers can make a good PC feel brokenScan driver issues before chasing fixes manually.Scan NowHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsPC HealthRecommendedCrashes, freezes, slowdowns? Check your PC nowSpot repairable issues before they interrupt work.Check PC×
Skip to content
World desk4 min

Can AI Detectors Reliably Identify AI-Written News?

AI detectors can sometimes identify generated text in defined tests, but no score reliably proves who wrote a news story or how AI was used.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

No—not reliably across all news stories. AI detectors can sometimes identify particular AI-generated text under defined test conditions, but their results vary with the tool, generator, language, text length and editing. A detector score is an uncertain clue, not proof that a journalist or newsroom used AI.

What an AI detector can—and cannot—tell you

A text detector looks for patterns associated with the material it was trained or tested to recognize. It does not inspect a story’s reporting history, identify who wrote each sentence, or establish whether AI was used for research, translation, editing or only part of a draft. A score therefore cannot, by itself, establish authorship or the degree of AI assistance.

As an Amazon Associate I earn from qualifying purchases.

Two errors matter. A false positive labels human-written text as AI-generated; a false negative fails to identify AI-generated text. The consequences depend on how the score is used, but a false accusation can damage a journalist’s reputation and undermine trust in a publication.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Why accuracy varies

The test and the writing may not match

Performance on one dataset does not automatically carry over to another genre, language or length. OpenAI said its 2023 classifier was unreliable on short text, performed significantly worse in languages other than English, and could be evaded by editing. In its English challenge set, it correctly marked 26% of AI-written text as “likely AI-written” and incorrectly flagged 9% of human-written text. Those figures describe that discontinued classifier on that test set—not today’s detectors as a group. OpenAI discontinued the classifier on July 20, 2023, citing its low accuracy. OpenAI’s explanation and results

#1 Best Overall
Upgraded Hidden Camera Detector - AI-Powered Anti-Spy Device, GPS Tracker & Bug Detector, Portable RF Signal Scanner for Hotels, Travel, Home & Office (Black)
  • Upgraded AI-Powered Detection: Military-grade technology detects hidden cameras, listening devices, and GPS trackers with precision. Enjoy peace of mind in hotels, offices, and even your own home. Stay one step ahead of hidden threats!
  • Simple, Fast & Effective: Just turn it on, sweep the area, and let the audible alarm + LED alerts notify you of threats. No technical skills needed - Press, Search, Relax! Skip expensive private investigators - protect yourself in seconds.
  • Compact & Travel-Ready: Lightweight, rechargeable, and pocket-sized for discreet, on-the-go security. Toss it in your bag, purse, or pocket - perfect for travel, work, and public spaces.
  • Total Privacy Protection: Don’t gamble with your security. Safeguard against spying in hotel rooms, changing rooms, offices, cars, dorms, and more. Know for sure if you’re being watched, recorded, or tracked.
  • Trusted by Experts & Customers: Designed with cybersecurity and counter-surveillance professionals. Join 300,000+ satisfied users who rely on our detectors for ultimate privacy & safety.

News writing has recognizable conventions

News stories often use concise, structured language and familiar forms of attribution. The authors of J-Guard caution that general-purpose detectors may mistake professional journalistic style for AI writing, while paraphrasing and other edits can weaken detection. Their news-aware framework explores a tailored approach; it does not establish that a newsroom can conclusively determine authorship with a universal detector. J-Guard paper

Tools and generators do not perform uniformly

NIST’s text-to-text pilot, published June 25, 2025, evaluated generated summaries and discriminator systems using article groups. It found substantial variation: some generators deceived most tested discriminators, while some discriminators detected content from almost all tested generators. Results also improved across testing rounds. That is evidence that detection can work in defined tests, not that a single accuracy figure applies to arbitrary news coverage. NIST’s pilot overview and results

What published evaluations show

Studies can be useful, but their findings must stay tied to the tools, text and conditions they tested.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Evaluation What it tested or found What the result does—and does not—show
OpenAI classifier (2023) 26% true positives and 9% false positives on its English challenge set. Results for one classifier and test set, not a market-wide or current estimate. OpenAI later discontinued the classifier. Source
Weber-Wulff et al. (2023) Evaluated 12 publicly available tools and two commercial systems; concluded the tested systems were not accurate or reliable overall. Obfuscation significantly worsened performance. The study focused on academic text, not newsroom attribution. Study
AI-detection tools study (2025) Reported 19% overall accuracy for ZeroGPT, PhraslyAI and Grammarly AI Detector across five plausible conditions of AI use. A result specific to the study’s sample, methods and tested conditions—not a general accuracy estimate. Study
NIST GenAI pilot (published 2025) Found marked variation by generator and discriminator rather than one cross-tool accuracy figure. A benchmark of defined systems and tasks; it does not settle performance on every real-world news story. Report
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

How to assess a detector result responsibly

If a score is being used to assess a specific news story, ask what evidence sits behind it before drawing a conclusion:

  • Which tool and version? A result cannot be interpreted without knowing what produced it.
  • What text was tested? Genre, length and language affect whether an evaluation applies to the story in question.
  • What were the error rates? Look for both false positives and false negatives, not just a headline accuracy number.
  • Was the text edited or mixed-authored? Human revisions, paraphrasing, translation and partial AI assistance can complicate classification.
  • What happens if the detector is wrong? A tentative lead for further checking is not a sound basis for a public accusation or employment decision.

OpenAI cautioned that its classifier “should not be used as a primary decision-making tool, but instead as a complement to other methods of determining the source of a piece of text.” OpenAI’s statement

What to check instead of relying on a score

When authorship matters, investigate the reporting and publication process rather than treating a detector output as a verdict. Depending on what is available, that can include:

  • Reporting records and source materials supporting the story’s claims.
  • Drafts and revision history that show how the text developed.
  • The author’s or newsroom’s account of its process.
  • Independent verification of the story’s factual claims.

These checks can provide evidence about reporting and provenance. They still may not establish every tool used or which passages involved AI, particularly in a mixed human-AI workflow.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Outdated Drivers Are Slowing You DownFree scan - exact matches
Windows Errors? Fix Them Before They SpreadFree repair scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.