Halloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsPC HealthRecommendedCrashes, freezes, slowdowns? Check your PC nowSpot repairable issues before they interrupt work.Check PCHalloween DealsAmazon USOctober picks are moving - compare before checkoutAmazon US: current deals, useful picks and tech finds.See Picks×
FREEDOM251

Freedom251 › Blog › AI Regulation

What the EU AI Act Requires Companies to Test—and What It Cannot Measure Yet

By Freedom251 Team · · 6 min read

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The EU AI Act requires documentation and evaluation in defined cases, but it does not create one universal test that can establish whether every AI model is safe. Its effectiveness depends partly on whether providers and regulators can turn legal duties into valid, relevant evidence.

How does the EU AI Act test AI?

It does not prescribe a single test suite for every model or system. Instead, it creates different duties for general-purpose AI (GPAI) model providers and for providers of certain AI systems. Depending on the case, the evidence may include technical documentation, model evaluations, adversarial testing, or a system-level conformity assessment.

As an Amazon Associate I earn from qualifying purchases.

That distinction matters: a legal requirement to evaluate or document a system is not itself a measurement method. A test must still define what is being measured, how the result is produced, and what the result can reasonably show.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What must GPAI providers document and evaluate?

Baseline duties for GPAI models

Article 53 of Regulation (EU) 2024/1689 requires a GPAI model provider to prepare and keep current technical documentation, including the model’s training and testing process and evaluation results. The Article’s wording is to “draw up and keep up-to-date the technical documentation of the model, including its training and testing process and the results of its evaluation.”

This is a documentation obligation, not a universal benchmark. Providers must record relevant work and results, but Article 53 does not establish one test that every model must pass. The European Commission’s GPAI guidance also notes that some obligations, including testing documentation, can concern the development phase before a model is placed on the market.

Additional duties for GPAI models with systemic risk

The Commission’s guidelines describe a distinct, stronger set of obligations for providers of GPAI models with systemic risk. They include model evaluation using standardised protocols and state-of-the-art tools; conducting and documenting adversarial testing; assessing and mitigating systemic risks at Union level; reporting serious incidents; and protecting the model and its physical infrastructure with cybersecurity measures.

These requirements should not be generalized to every GPAI model or every AI system. They also show why the headline is an argument about implementation, not proof that the Act contains no testing duties: for systemic-risk models, evaluation and adversarial testing are expressly part of the Commission’s description of provider obligations.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

How are GPAI models different from high-risk AI systems?

The Act regulates models and systems through related but separate routes. A GPAI model is a general-purpose component; an AI system is assessed in the context of what it does and how it is used. The Commission’s Q&A says GPAI obligations apply to a model regardless of its ultimate use, while AI-system requirements depend on use context. A company integrating its own GPAI model into a system may therefore have responsibilities in both roles.

Route What is in scope What the evidence or procedure concerns
GPAI provider duties The general-purpose model Training and testing documentation and evaluation results; additional evaluation, adversarial testing, risk mitigation, incident reporting, and cybersecurity duties for models with systemic risk
High-risk AI system conformity assessment The AI system and its applicable legal category A conformity-assessment procedure determined by the relevant product and Union harmonisation legislation; harmonised standards or common specifications may be relevant
AI Office evaluation A GPAI model being assessed for compliance or investigated for systemic risks Regulator-led evaluation, potentially using independent experts and technical access to the model

Article 43 governs conformity assessment for high-risk AI systems, but the applicable procedure varies with the system category and relevant legislation. It does not mean that every high-risk system goes through the same independent laboratory test or third-party review. System conformity assessment should not be confused with the GPAI model-evaluation regime.

Can regulators test a model themselves?

Yes. Under Article 92, the AI Office may evaluate a GPAI model when the information it has gathered is insufficient to assess provider compliance or to investigate systemic risks. The Commission may appoint independent experts. The Office may request access through APIs or other suitable technical means and tools, including access to source code. Article 92 also provides for implementing acts setting detailed arrangements for these evaluations.

That authority provides a route beyond relying solely on a provider’s account of its own testing. But access to a model is not automatically a complete evaluation: the regulator still needs suitable procedures, expertise, and evidence tied to the question it is investigating.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What counts as an AI safety test?

There is no single answer that applies to every model and risk. A test is useful only in relation to a defined claim—for example, whether a model resists a specified class of misuse, performs reliably on a relevant task, or produces materially different outcomes across groups. The chosen data, task, metric, and testing conditions determine what a result can support.

NIST’s overview of AI measurement and evaluation describes a broad toolkit: metrics, tasks, challenge problems, testbeds, software tools, datasets, and work to identify technical gaps. Accuracy and robustness have commonly been evaluated, while bias, interpretability, and transparency also involve measurement and evaluation activity. This is technical context from a US authority, not a requirement under EU law.

In practice, a credible evaluation should connect a risk or performance claim to the test that examines it. It should make the conditions and limits of the result clear, including what the test did not cover. A score on one benchmark, for instance, cannot by itself establish that a model is safe across different users, settings, or forms of use.

What can TEVV-Athlon contribute?

NIST’s TEVV-Athlon is an example of work to structure customised assessments around an organisation’s testing, evaluation, verification, and validation objectives. Its four-stage approach uses “Events and Tools” to produce data about measurement concepts. It is a US technical framework, not an EU legal requirement or an EU standard.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

NIST’s public comment period for the framework ran from 7 August to 6 October 2026 and has closed. A consultation and a framework for designing assessments can support practical measurement work; neither fact establishes that the framework is effective for every use or that all relevant risks now have adequate tests.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

What is in force, and when?

The Commission’s provider guidance says GPAI obligations began applying on 2 August 2025, while the Commission’s enforcement powers for those obligations began applying on 2 August 2026. As of 11 October 2026, both dates have passed. These are dates for GPAI obligations and related Commission enforcement powers, not a claim that every AI Act requirement for every system took effect on those dates.

The European Commission also says the GPAI Code of Practice was published on 10 July 2025, following work involving nearly 1,000 stakeholders. The Code is implementation support; participation in drafting it does not establish that its tests are comprehensive or that every risk can now be measured adequately.

What should providers and public buyers look for in test evidence?

The legal requirement depends on the provider’s role and the model or system at issue. As a practical way to assess the quality of evidence—not as a substitute for checking the applicable legal procedure—ask:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • What claim is being tested? A test should address a stated capability, risk, or requirement rather than offer an unexplained score.
  • What are the conditions? Identify the model version, data, task, environment, and relevant assumptions so the result can be interpreted.
  • What does the test miss? Record known coverage limits and risks for which the method does not provide adequate evidence.
  • Can the result inform a decision? Evidence should connect findings to appropriate mitigation, deployment conditions, or further evaluation.
  • Who has checked the evidence? Distinguish provider-generated material from regulator-led evaluation or other independent assessment.

For a GPAI model integrated into an AI system, the assessment should also keep both levels visible: model-level evidence does not automatically answer every question about the system’s use, and system-level conformity work does not erase applicable model-provider duties.

What the title does—and does not—mean

The EU AI Act can impose duties to document, evaluate, mitigate, and submit to oversight. The harder question is whether the available methods produce evidence that is valid for the specific model, risk, and use. A statutory obligation can make organisations and regulators accountable for doing this work; it cannot, by itself, make an inadequate test meaningful.

That is why “can’t regulate what we haven’t learned to test” is a warning about the dependency between law and measurement, not a demonstrated verdict that the Act is ineffective. The Commission’s guidance, the GPAI Code, regulator evaluation powers, and technical assessment frameworks are implementation mechanisms. Their existence does not settle whether test methods cover every important risk or support every necessary decision.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

AI RegulationAI SafetyAI testingEU AI ActGPAINIST

Leave a Reply

Your email address will not be published. Required fields are marked *

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Recommended PC Tool
Recommended PC Tool
Outdated Drivers Are Slowing You DownFree scan - exact matches
PC Slower Than It Used to Be?Free scan - under a minute

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.