DriversRecommendedOutdated drivers can make a good PC feel brokenScan driver issues before chasing fixes manually.Scan NowOctober DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsPC HealthRecommendedCrashes, freezes, slowdowns? Check your PC nowSpot repairable issues before they interrupt work.Check PC×
Skip to content
World desk5 min

Why 80 Correct AI Definitions Still Weren’t Enough

A test of 80 AI answers found every definition correct, but correctness alone did not make the answers trustworthy. Here is how to check the sources behind important claims.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

In a test reported by Tony G. of Sourcelift, all 80 AI answers defined their terms correctly. That did not mean the answers were trustworthy: many lacked primary-source support or included details the author judged unsupported, stale, or inconsistent with official guidance. The key distinction is between getting a definition right and making consequential claims traceable to sources that actually support them.

What the 80-answer test measured

Tony G., Sourcelift’s founder, reported that the test was run on September 29, 2026, and described in an article published by The AI Journal on October 5, 2026. The team asked ChatGPT, Claude, Gemini, Perplexity, and Google AI Overviews the same 16 questions about eight AI-search terms, once in English and once in Spanish, for 80 answers total.

As an Amazon Associate I earn from qualifying purchases.

The terms included GEO, llms.txt, query fan-out, and E-E-A-T. The team used logged-in consumer apps with default settings and read Google AI Overviews on google.com. Answers were read in full and checked against what the article calls primary sources, including originating papers and official documentation. The author says claims considered unsourced, outdated, or contradicted were also flagged.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The article reports that all 80 answers defined the terms correctly. It also reports that 21 of the 64 answers from ChatGPT, Claude, Gemini, and Perplexity linked a primary source; Google AI Overviews were excluded from that citation count. These are results from the author’s sample, not general rates for the systems.

Why a correct definition can still mislead

An answer may accurately explain a term and still make an unreliable claim about a number, date, recommendation, or attribution. A definition answers “What does this mean?” A supporting source helps answer “Why should I believe this specific detail?” Those are separate tests.

A link is not proof by itself. It may lead to a relevant page without supporting the sentence beside it, or it may point to guidance that has since changed. Open the source and check whether it backs the precise claim, in the relevant context and at the relevant date. OpenAI’s ChatGPT Search help page, as quoted in Tony G.’s article, puts the practice this way: “Open a cited source to check that it supports the answer.”

Where the test found problems beyond definitions

Precise-sounding numbers without a cited basis

Tony G. reports that a Google AI Overview gave a typical query fan-out estimate of 5 to 12 searches, while Gemini’s Spanish answer gave a range of 5 to more than 20. The article says the Google documentation it consulted described query fan-out but did not provide a number. These are examples of answers in this test, not verified descriptions of what either system does internally.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Details that may already be stale

The article reports that an AI Overview described the feature as available in more than 120 countries, while Google had announced availability in more than 200 countries and territories on May 20, 2025. Because coverage can change, this comparison should not be treated as a current availability statement; check Google’s current official information before relying on it.

Recommendations that conflict with platform guidance

According to the article, Gemini recommended FAQPage and HowTo markup and answer blocks of 40 to 60 words. The author contrasted this with Google guidance that did not require special schema.org markup and noted that FAQ rich results stopped appearing in Google Search on May 7, 2026. Search guidance and search features evolve, so confirm current recommendations in Google Search Central rather than applying these examples as standing advice.

Missing credit and language-specific naming

The article says only Claude credited the 2023 paper that introduced GEO, and none of ten answers about retrieval-augmented generation credited the 2020 paper that named it. It also reports that two Spanish answers used names for Google AI Overviews that Google does not use. These are observations from the tested answers, not a complete audit of citation or translation quality.

For primary-source links and language results, the article reports that 14 of 32 English answers and 7 of 32 Spanish answers linked a primary source. That difference raises a worthwhile question about how answers cite sources across languages, but 32 answers per language in a one-day test cannot establish a general performance gap.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

What the results do—and do not—show

The test offers a useful warning: fluent, correct definitions can sit alongside unsupported or outdated specifics. But it is a small snapshot, not a ranking of AI systems. Tony G. describes one run per question on a single day; AI answers can vary, and a different prompt, session, or date may produce a different response.

The article also relays figures from other studies, including a European Broadcasting Union/BBC review said to have found serious sourcing problems in 31% of more than 3,000 news answers, and a 2023 audit said to have found that 74.5% of citations supported the sentence they were attached to. Those figures are claims as reported by Tony G.; they should not be treated as independently confirmed here or as directly comparable to Sourcelift’s test, which used a different sample and approach.

How to check an AI answer before acting on it

  1. Separate the definition from the details. Mark numbers, dates, named sources, availability claims, and recommendations. These are often more consequential and easier to get stale than a basic definition.
  2. Open the cited source. Find the passage that supports the exact sentence. A source about the general topic may not substantiate the specific number or recommendation.
  3. Prefer the originating authority. For a product feature or search requirement, use the platform’s current official documentation; for a research claim, look for the original paper or report rather than a summary.
  4. Check the date and scope. Confirm when the source was published or updated and whether it applies to your country, product version, language, or use case.
  5. Compare answers carefully when language matters. Ask equivalent questions in the languages relevant to your decision, then verify each answer against sources available in those languages. A difference is a prompt to investigate, not proof that one language performs worse.
  6. Use clean, repeatable conditions for a benchmark. Record the prompt, system, date, app or interface, account state, and settings. Use fresh sessions where possible, and repeat prompts if you want to estimate variability rather than capture a single snapshot.

The article reports that 12 of 16 ChatGPT answers reflected account-related context despite temporary chats. That is a finding about the author’s test setup, not a guarantee about other accounts or current product behavior; it illustrates why session and account conditions should be recorded in comparisons.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Outdated Drivers Are Slowing You DownFree scan - exact matches
PC Slower Than It Used to Be?Free scan - under a minute

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.