October DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsSlow PC?RecommendedPC slow today? Run a repair scan before it gets worseResolve common Windows issues and optimize system performance.Scan NowOctober DealsAmazon USDeal season is back - check today's better picksAmazon US: current deals, useful picks and tech finds.See Picks×
Skip to content
World desk6 min

How to Assess AI Vendors’ Data Handling and Security Claims

Assess AI vendors by mapping each data flow, checking evidence for the exact service, and turning retention, training, security, and deletion promises into testable terms.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Assess an AI vendor by tracing what happens to your specific data in the exact service you plan to use, then verifying those claims in current evidence and enforceable contract terms. A security report or framework alignment can help organize review, but neither proves how every product, account tier, or configuration handles your data.

Start with the use case and the supplier chain

Before reviewing a vendor’s assurances, write down what you intend to do with the AI service and what could go wrong. The same product may be suitable for public text but not confidential customer records, depending on its data practices, configuration, and the consequences of exposure or failure.

As an Amazon Associate I earn from qualifying purchases.

  • Use and people affected: Describe the task, users, and anyone whose information or decisions may be affected.
  • Data and impact: List the data classes involved and the impact if information is exposed, altered, retained unexpectedly, or unavailable.
  • Supplier role: Identify whether the company is the model provider, application provider, integration layer, or a subprocessor. Record embedded models and other services that may receive data.

NIST’s supplier guidance treats due diligence as an investigation of relevant information about a supplier or product before a new acquisition or when reviewing an existing system. Its ICT supplier considerations include provenance, resilience, foundational cybersecurity practices, supply-chain tiers, and ownership, control, or influence where relevant. NIST SP 1326 provides a useful structure, but it is guidance for supplier assessment—not proof that a particular AI service is safe.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Map every route your data can take

Ask the vendor for a current data-flow diagram covering the exact service and deployment. If the vendor cannot provide one, request a written explanation detailed enough to establish where each data category goes and which parties can access it.

#1 Best Overall
SecuX PUFido USB-C Security Key with PUF Technology, FIDO2/U2F Certified, Hardware-Rooted Unclonable Security for Passwordless Login and 2FA Authentication
  • A FIDO security key with PUF technology provides a unique, hardware-rooted trust anchor that resists tampering and cyber attacks, offering stronger security than conventional designs.
  • FIDO2 Certified Protection – Enjoy phishing-resistant security with FIDO2 certification, ensuring top-tier account safety across Windows, macOS, Linux, iOS iOS, Android and more.
  • Easy to use & Portable – Designed with a compact USB-C interface, Clife key fits easily on your keychain for secure access anywhere. Simply plug in and authenticate with ease.
  • Universal Compatibility – Works seamlessly with hundreds of FIDO2/U2F compliant services, including popular cloud, email, and social platforms.
  • Backup recommended – To ensure continuous access, register a backup Clife security key as a spare in case your primary key is lost.
  • Prompts, uploaded files, generated outputs, and user feedback
  • Logs, telemetry, analytics, and diagnostic data
  • Support access, backups, and disaster-recovery copies
  • Fine-tuning, evaluation, product-improvement, or other feedback paths
  • Subprocessors, embedded models, and downstream model services

For each category, ask what is collected and why; where it is processed and stored; who can access it; how long it persists; and what deletion covers, including backups and derived artifacts. Ask directly whether it may be used for model training, evaluation, product improvement, or another secondary purpose. Do not treat “not used for training” as a complete answer: it does not, by itself, explain logging, retention, human access, or other uses.

NIST’s Generative AI Profile calls for attention to embedded AI dependencies, privacy, security, and ongoing supplier monitoring. Its guidance also supports keeping an inventory of third parties that can access organizational content. See the NIST Generative AI Profile and NIST’s AI RMF Playbook.

Check the evidence against the service you will use

Request current security and privacy materials for the actual product, deployment, account tier, geography, and configuration under consideration. Useful evidence may include independent audit reports or certifications, a scope statement, security architecture, access-control and encryption descriptions, vulnerability-management practices, incident-response commitments, retention and deletion controls, and subprocessor disclosures.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Read the boundaries, not just the report name. Check the report period, exceptions, systems covered, and whether the relevant AI service and data processing fall within scope. A report can provide evidence about controls assessed within its defined scope; it does not establish training-data handling, privacy compliance, or model behavior unless those matters are specifically addressed. The same caution applies to a framework claim: alignment is not a guarantee about every product or customer configuration.

Rank #2
SecuX PUFido® Drive Clife Key USB C Security Key with PUF Technology and Built in Flash Drive, FIDO2 U2F Certified Hardware Rooted Unclonable Security for Passwordless Login and 2FA Authentication (1)
  • Hardware-Rooted Security with PUF Technology – PUFido Drive Clife Key uses Physical Unclonable Function technology to generate a unique, hardware-based identity that cannot be duplicated, delivering stronger resistance against tampering and cyber attacks than conventional security keys.
  • FIDO2 Certified Phishing-Resistant Protection – Fully compliant with FIDO2/U2F standards, enabling secure passwordless login and two-factor authentication to help protect accounts from phishing and credential theft.
  • Security Key + Flash Drive in One Device – Combines a FIDO security key with a built-in USB flash drive, allowing you to carry files and a hardware authentication key together in a single compact device.
  • Easy to Use & Portable – Compact USB-C design fits easily on a keychain or in a pocket. Simply plug in the Drive Clife Key to authenticate or access stored files with no extra software required.
  • Universal Compatibility – Works with hundreds of FIDO2/U2F compatible services and supports Windows, macOS, Linux, iOS, Android, and other major platforms.

NIST’s Generative AI Profile recommends due diligence that includes checking incident and vulnerability information and continuing to monitor third-party risks. Treat documents as one part of verification, alongside direct answers, contract commitments, and your own assessment of the use case.

Assess dependencies, provenance, and resilience

Ask who owns or controls the supplier when that could affect your risk, what major components and model services it relies on, and how it tracks material changes. Establish what happens if a provider becomes unavailable, changes its service, or can no longer meet your requirements. Identify a workable fallback for high-impact uses rather than assuming the service will remain unchanged.

NIST SP 1326 includes supplier provenance, resilience, supply-chain tiers, and ownership, control, or influence among its due-diligence considerations. The Generative AI Profile also recommends identifying over-reliance on third-party data and documenting fallback plans. Apply these questions in proportion to the use case: a dependency that is tolerable for a low-impact assistant may be unacceptable for a critical workflow.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Turn assurances into contract terms you can verify

Statements such as “we do not train on your data” or “we delete your data” need precise definitions. Have qualified counsel review the agreement for your jurisdiction, sector, data types, and use case. Check that the contract, applicable service terms, and any service-level agreement cover the commitments that matter to your deployment.

Rank #3
Sale
Thetis Nano-A FIDO2 Security Key Hardware Passkey Device with USB Type A, TOTP/HOTP, FIDO2.0 Two Factor Authentication 2FA MFA, Works with Windows/mac/iOS/Android/Linux/Gmail/Facebook/GitHub/Coinbase
  • Ultra-Compact FIDO2 Security Key - Plug-and-stay or carry on a keychain. This USB-A hardware security key offers portable, always-on protection for desktop and mobile use. (Item Size: 0.75 X 0.74 IN x 0.25 IN)
  • USB-A Hardware Key for All Devices - Works with USB-A ports on PC, Mac, Android, and other laptop/notebook device. Enables secure, cross-platform login with FIDO2.0 passkey support.
  • FIDO Certified Security Key - Meets FIDO and FIDO2 standards. Works with Google, Microsoft, GitHub, Dropbox, and more. Please check service compatibility before purchase.
  • Passwordless Login with Passkey - Supports passkey login via WebAuthn and CTAP2. Enjoy password-free sign-ins where supported. Not all websites or services currently support passkeys.
  • Advanced Multi-Factor Authentication - Offers 200 FIDO2 passkey slots and 50 OATH-TOTP slots. Strong, flexible 2FA/MFA support across various apps and authentication platforms.
  • Covered data and services: Define which inputs, files, outputs, logs, and derived data are covered, and name the services and configurations to which the promise applies.
  • Permitted use: Specify allowed purposes, including whether data may be used for training, evaluation, product improvement, or other secondary uses, and list any exceptions.
  • Retention and deletion: Set retention periods and deletion timing and scope, including treatment of backups and derived artifacts.
  • Subprocessors and changes: Require appropriate downstream obligations and define notice, approval, or objection rights for material changes to subprocessors, model providers, or data practices.
  • Security and incidents: Set security requirements, incident notification and cooperation duties, and expectations for addressing material vulnerabilities or control failures.
  • Evaluation and exit: Address audit or evaluation rights, content ownership and usage rights, quality and provenance expectations, and how data can be exported or deleted at termination.

NIST recommends that contracts and SLAs address content ownership, usage rights, quality, security requirements, and provenance, and allow evaluation of third-party GAI processes and standards. It also flags risks from non-standard terms, unexpected liability effects, and unauthorized secondary data use. A promise is more useful when its scope, exceptions, verification method, and remedy are clear.

Compare vendors on the same decision criteria

Use one set of questions for every candidate, and score each answer against your actual data and impact requirements. A side-by-side record helps separate a genuine difference from a gap in disclosure.

Assessment area What to compare
Data use and minimization Data collected, permitted purposes, training and secondary-use terms, and whether unnecessary data can be excluded.
Retention and location Retention periods, deletion scope and timing, storage and processing locations, and backup treatment.
Dependencies Subprocessor visibility, embedded models, downstream services, and notice of material changes.
Assurance evidence Scope, recency, exceptions, and whether the specific AI service and processing are covered.
Security operations Access controls, encryption, vulnerability handling, incident response, and relevant incident history.
Contract rights Audit or evaluation, incident notification, change notice, data export, and termination rights.
Fit and resilience Suitability for the intended use, provider concentration, fallback options, and impact if service fails.

There is no single universally correct trade-off among security, privacy, reliability, explainability, and other trustworthiness characteristics. NIST’s AI Risk Management Framework says deployment decisions should weigh these characteristics, risks, impacts, costs, and benefits in context and with input from interested parties. The NIST AI RMF 1.0 is voluntary guidance, not a certification. NIST says the framework is being revised, so check its current status before relying on it operationally.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Keep reviewing after approval

Vendor risk can change after procurement. Keep an inventory of approved AI services and the third parties with access to organizational content, then set a review cadence appropriate to the use and sensitivity of the data.

Rank #4
Thetis Pro FIDO2 Security Key Passkey with Complex Pin [PinPlex], Hardware Device Supports USB A, Type C &NFC, TOTP/HOTP Authenticator APP, PIV Certificates, FIDO 2.0 Two Factor Authentication 2FA MFA
  • Dual USB-A and USB-C Security Key – Features both USB-A and USB-C connectors for seamless compatibility across desktops, laptops, and tablets. Supports plug-and-stay use or keychain carry.
  • NFC-Enabled for Mobile Access – Built-in NFC allows fast, wireless authentication with Android and iPhone devices. Ideal for mobile logins and on-the-go security.
  • FIDO Certified for Strong Authentication – [CHECK COMPATIBILITY before purchase] Fully compliant with FIDO2 and FIDO U2F standards. Works with major platforms like Google, Microsoft, GitHub, and Dropbox.
  • Passwordless Login with PinPlex – Supports secure passkey login via WebAuthn and CTAP2 with added protection from PinPlex, a complex PIN system that enhances physical security.
  • Multi-Layer Authentication Support – Includes PIV certificates and supports both TOTP and HOTP for strong 2FA/MFA coverage across enterprise and consumer apps.

Trigger a reassessment when a vendor adds a model provider or subprocessor, changes retention or data-use terms, expands the data collected, reports a security incident, receives a material audit exception, undergoes an acquisition, or is used for a materially different purpose. Review incident and vulnerability information, confirm that contract commitments still match actual service terms, and test contingency arrangements for critical workflows. NIST’s Generative AI Profile recommends ongoing monitoring, incident-response planning, and documenting third-party GAI incidents.

Frequently Asked Questions

How can I tell whether an AI vendor uses my data to train its models?

Ask for a written answer that defines covered data, services, and configurations, and distinguishes training from evaluation, product improvement, logging, and other secondary uses. Confirm the answer in contract terms, including exceptions and downstream-provider obligations.

Is a SOC 2 report enough to trust an AI vendor?

No single report name is enough. Check the report period, scope, exceptions, and whether the AI service and relevant data processing are covered; a security report alone does not establish training-data handling, privacy compliance, or model behavior.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What should an AI vendor contract say about my data?

It should define the covered data and services, permitted purposes, retention and deletion, subprocessor obligations, material-change notices, security and incident duties, evaluation rights, and data export or deletion at termination.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Windows Errors? Fix Them Before They SpreadFree repair scan
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.