DriversRecommendedOutdated drivers can make a good PC feel brokenScan driver issues before chasing fixes manually.Scan NowOctober DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsWindows FixRecommendedWindows errors stealing your time? Find the fix fastScan stability, cleanup and performance issues.Fix Now×
Skip to content
Applitools

Applitools Visual Regression Testing: A Practical Guide to Eyes, Baselines, Match Levels, and CI

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Applitools Eyes visual regression testing captures a rendered interface at defined checkpoints, compares each image with a saved baseline, and sends differences to a reviewer. The first run normally creates the baseline; subsequent runs become a repeatable review loop: drive the UI to a meaningful state, capture it, inspect the diff, then accept an intentional change or keep the old baseline when the change is a defect.

Eyes complements functional assertions. A test can prove that a button is present and clickable, while a visual checkpoint catches a shifted layout, wrong font, missing icon, or unexpected color. It does not decide whether every difference is good or bad for your product—your team does.

What Applitools visual regression testing actually does

A visual test uses an existing automation script to reach a stable UI state, then sends a screenshot checkpoint to Eyes. Eyes compares that checkpoint with the baseline associated with the test, environment, and checkpoint name. On an initial run, there is no reference image, so the captured image is stored as the baseline. Later runs report changed regions for review.

The repeatable Eyes loop

  1. Arrange a meaningful state. Log in with deterministic data, open the target route, expand the relevant component, and wait for the state your users should see.
  2. Capture a checkpoint. Give it a stable name such as Checkout - payment form. Capture the viewport, a full page, or a selected element according to the SDK.
  3. Compare with the baseline. Eyes highlights candidate differences and provides side-by-side and toggle views.
  4. Investigate. Determine whether the change is an intended design or content update, an environment difference, or a defect.
  5. Resolve deliberately. Accept an intentional change and save the new image as the baseline. Reject a defect and retain the previous baseline while fixing the implementation.

Keep functional checks—URLs, accessible names, API responses, and business rules—alongside visual checkpoints. A page can look unchanged while a control is unusable, and a harmless timestamp can create a visual diff without a functional regression.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
#1 Best Overall
Ishihara Test Chart Books, for Color Deficiency
  • Grafco Ishihara Test Chart Book
  • Package Info: Each
  • Includes four special plates for tests to determine the kind and degree of defect in color vision.
  • Image may not reflect actual product sold. Please read description carefully.
  • GHF1254

Prerequisites and choosing an Eyes SDK

Eyes connects to your existing automation through framework-specific SDKs. Applitools’ SDK chooser covers web, component, mobile, and PDF/image targets, with options such as Cypress, Playwright TypeScript Fixtures, Selenium Java, and WebdriverIO. Select the SDK matching your language, runner, and surface rather than adapting an unrelated example.

Prepare deterministic test inputs

  • Use seeded accounts and fixture data so prices, names, and list ordering do not change between runs.
  • Freeze or mask clocks, rotating promotions, ads, avatars, and other intentionally variable content.
  • Set a known viewport, browser, device scale, locale, timezone, and color scheme.
  • Wait for fonts, images, network calls, and animations before the checkpoint. Prefer a semantic ready condition over a long arbitrary sleep.
  • Give each checkpoint a durable name; renaming it creates a new baseline history.

Match levels: Strict, Layout, and Ignore Colors

Match levels express what a checkpoint should notice. Choose based on content variability and the decision you want the test to make; there is no universally “best” level.

Match level Detects Useful when Trade-off
Strict Perceptible changes to text, fonts, colors, graphics, and element position A mostly static page is tested on a particular browser and operating system Dynamic data, rendering differences, or cross-platform font changes can create noise
Layout Presence and relative position of elements while ignoring actual text, graphics, color, and much styling Content is dynamic, localized, or one baseline is shared across browsers, operating systems, devices, viewports, or orientations Important visual styling and copy changes will not be the signal
Ignore Colors Strict-style differences except color changes Structure and typography matter but themes or color palettes vary Contrast, brand-color, and status-color regressions can be missed

Start with the narrowest level that reflects the requirement. If a Layout test hides a meaningful styling defect, use Strict for that checkpoint or split the page into checkpoints with different goals. Do not weaken every test merely to reduce review work.

Handling dynamic and intentional differences

The dashboard supports targeted controls such as ignore, floating, strict, and dynamic regions. Apply them only to known, bounded variability—for example, a live clock or an externally generated recommendation tile. A broad ignored rectangle can conceal a real regression, so keep regions as small as possible and document why each exists.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #2
Ishihara Colour Vision Test Book for Color Deficiency 24 Plates with User Manual
  • individuals with color vision defect should see a different figure from individuals with normal color vision.
  • Makes use of the peculiarity that in red-green blindness, blue and yellow appear remarkably bright compared with red and green
  • Diagnostic plates: intended to determine the type of color vision defect
  • Ishihara Test Chart Books for Color Deficiency 24 Plates with usar manual

Reviewing a reported diff

  1. Use the side-by-side view to identify the exact changed component.
  2. Use the toggle view to spot small shifts, missing pixels, or text wrapping changes.
  3. Check whether the difference is confined to a declared dynamic region.
  4. Inspect the source change, browser, viewport, locale, and test data.
  5. Accept only when the product decision is intentional; otherwise reject and fix the code.

Adding Eyes to Playwright or another test suite

The exact import and lifecycle calls depend on the selected SDK version. The general shape is consistent: initialize an Eyes instance in the test fixture, open a test with an application and test name, capture checkpoints, close Eyes, and ensure the test run is finalized in teardown. Use the current SDK example for your framework so options and authentication match the installed package.

Checkpoint design

  • Capture after navigation and after each meaningful interaction, not after every click.
  • Prefer names that describe user-visible state: Account - empty state, Cart - three items, or Dialog - validation error.
  • Use element checks for reusable components and full-page checks for page composition.
  • Keep a small number of high-value checkpoints per test; hundreds of nearly identical images make review slower.

CI execution

Store the Applitools API key as a protected CI secret. Pin browser and SDK versions, publish the Eyes result link as a CI artifact, and run the same viewport and locale in pull requests. Separate baseline approval permissions from ordinary test execution so an unexpected change cannot be silently approved by the job that produced it.

Storybook visual testing

The documented Storybook path uses the Eyes Storybook SDK:

  1. Install @applitools/eyes-storybook.
  2. Run npx eyes-setup in the Storybook project.
  3. Provide an Applitools API key through the project’s configuration or environment.
  4. Run npx eyes-storybook, or point the command at an already running Storybook instance.
  5. Review discovered stories and their checkpoints in the Applitools dashboard; approve the initial images and later intentional updates.

An Eyes Storybook Addon is also available for teams that prefer a UI-first workflow. Keep stories deterministic: mock network responses, fix viewport parameters, and avoid random IDs or times in rendered output.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #3
Ishihara Test Chart Books for Color Deficiency 38 Plates with User Manual and One Eye Occluder by KASHSURG
  • Vanishing design: Only people with good color vision can see the sign. If you are colorblind you won’t see anything.
  • Transformation design: Color blind people will see a different sign than people with no color vision handicap.
  • Hidden digit design: Only colorblind people are able to spot the sign. If you have perfect color vision, you won’t be able to see it.
  • Classification design: This is used to differentiate between red- and green-blind persons. The vanishing design is used on either side of the plate, one side for deutan defects an the other for protans.

Applitools MCP: what it can and cannot automate

The official Applitools MCP setup documents AI-assistant flows for configuration, adding checkpoints, configuring Ultrafast Grid, inspecting visual results, and resolving differences. The documented setup requires Node.js 18 or newer and a compatible MCP client.

There is an important scope distinction: setup and checkpoint tools in the documented version support the Playwright TypeScript/JavaScript Fixtures SDK. Inspection and resolution tools can work with Eyes results produced by any SDK or language. Operations that read results and operations that change them use separate read and write API keys. Saving or resetting baselines is an explicit approval action, not an automatic side effect. Verify current requirements before rolling the integration into a production workflow because MCP capabilities and SDK support can change.

Baseline governance for teams

Who may approve

Assign reviewers who understand the affected product area. Require a pull request or issue reference for baseline updates, especially for shared components. A green visual run means “matches the approved reference,” not “a human has reviewed the design.”

When to branch baselines

Use separate environments or baseline variants when browser, operating system, device, orientation, locale, or color scheme legitimately changes rendering. Layout matching can support a shared baseline across more environments, but confirm that ignoring style and copy is acceptable for that test.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #4
NCE Visual Study Guide & Activity Book by Lindsay Braman - Spiral-Bound Test Prep for National Counselor Exam & CPCE - Illustrated Interactive Studying to Engage Creative, Neurodiverse, & ADHD Minds.
  • This illustrated & interactive study guide for the National Counselor Exam (NCE) uses images, colors, mnemonics, and humor to engage brains in effective study.
  • 150+ page activity book including coloring book pages, fill in the blank sheets, and tear-out flashcards with content addressing all domains covered in the NCE + CPCE counselor exams.
  • Full size 8.5x11, spiral-bound for lie-flat studying.
  • Printed on premium, 80lb textured paper you can color and highlight with no bleed.
  • Drawn by (human!) hand. Printed and bound in the USA.

Keeping history useful

  • Remove obsolete checkpoints when a screen is retired.
  • Review ignored and dynamic regions periodically.
  • Record intentional font, theme, and component-library migrations as baseline changes.
  • Investigate clusters of failures together; one missing web font can affect many checkpoints.

Performance, reliability, and cost considerations

Visual suites add screenshot capture, upload, comparison, and review time. Reduce runtime by checking only meaningful states, using element checkpoints where a full page is unnecessary, and running broad coverage in CI while keeping a focused pull-request set. Parallelize independent tests within the limits of your plan and browser infrastructure.

Reliability depends on stable rendering more than on pixel tolerance alone. Wait for network idle or a specific selector, disable animations, load the same fonts, and make third-party content deterministic. A failed navigation should fail the functional test rather than produce an approved blank baseline. Treat baseline storage and approval as controlled product assets; retain the previous reference until the change is understood.

Common failures and fixes

Symptom Likely cause Fix
Every pixel changes Wrong viewport, device scale, browser, font, or color scheme Pin those settings and verify fonts are loaded before capture.
Only timestamps or prices differ Uncontrolled test data or time Seed fixtures, freeze time, mock responses, or isolate a narrowly defined dynamic region.
Text wraps differently Font fallback, width change, localization, or missing web font Wait for the font, fix viewport and locale, and verify the font files are available in CI.
Checkpoint is blank or half-rendered Capture occurred before navigation, images, or client rendering completed Wait for a meaningful selector or network condition; do not approve the blank image.
Too many false positives across platforms Strict matching used for a cross-environment baseline Use Layout where only structure matters, or maintain environment-specific baselines.
Legitimate change keeps returning New image was reviewed but not saved as the baseline Complete the explicit baseline-approval action, then rerun the checkpoint.
MCP setup cannot add a checkpoint Unsupported SDK or missing Node.js/API-key requirement Use Playwright TypeScript/JavaScript Fixtures for documented checkpoint tooling, confirm Node.js 18+, and check read/write key configuration.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Or skip the browser setup

If you need a clean image or PDF of a URL rather than a framework-managed regression checkpoint, ScreenshotNeo provides a website screenshot API and MCP server. It accepts cookie and consent banners before capture and removes more than 60 known consent platforms, newsletter popups, and chat widgets; each cleanup step can be disabled. Bot checks, CAPTCHAs, blank pages, timeouts, failed loads, and cache hits are not billed, and response headers report the page verdict and billing status.

The API supports PNG, JPEG, WebP, and PDF, plus full-page lazy-image loading, CSS-selector element capture, dark mode, device presets or custom viewports, retina scale, custom CSS and JavaScript, clicks, waits, blocked requests, headers, cookies, user agents, Authorization, timezone, geolocation, transparent backgrounds, resizing, TTL caching, signed image links, asynchronous webhooks, bulk capture of up to 100 URLs per call, usage reporting, and an OpenAPI specification. An MCP server exposes take_screenshot, get_page_info, and capture_pdf to Claude, Cursor, and other MCP clients.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

One-call examples

See the ScreenshotNeo documentation for parameter details.

curl -G "https://api.screenshotneo.com/v1/shot" -d access_key=YOUR_API_KEY --data-urlencode url=https://stripe.com -o shot.webp
import requests
r = requests.get("https://api.screenshotneo.com/v1/shot", params={"access_key": "YOUR_API_KEY", "url": "https://stripe.com"}, timeout=90)
open("shot.webp", "wb").write(r.content)
const q = new URLSearchParams({ access_key: 'YOUR_API_KEY', url: 'https://stripe.com' });
const res = await fetch(`https://api.screenshotneo.com/v1/shot?${q}`);

The Free plan includes 1,000 screenshots per month without a card; paid plans start at $5 for 3,000 shots. Sign up for the free ScreenshotNeo plan to try it.

FAQ

Does a visual diff prove that a test failed?

No. It proves that the rendered checkpoint differs from its approved baseline. A reviewer must classify the difference as intentional or defective.

Can one Eyes baseline cover every browser and device?

Sometimes, but rendering requirements decide. Layout matching can support shared cross-environment baselines when structure is the goal; Strict comparisons are generally more suitable for a specific browser and operating system.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Should I ignore an entire page with frequent changes?

No. Narrow dynamic regions or choose a match level aligned with the requirement. Ignoring a large area can hide the regression you intended to catch.

The Bottom Line

Applitools Eyes is most effective when checkpoints are intentional, environments are reproducible, and a person owns baseline decisions. Use Strict, Layout, or Ignore Colors according to the change you need to detect, keep functional assertions in place, and treat every accepted baseline as a product decision.

Quick Recap

Bestseller No. 1
Ishihara Test Chart Books, for Color Deficiency
Ishihara Test Chart Books, for Color Deficiency
Grafco Ishihara Test Chart Book; Package Info: Each; Image may not reflect actual product sold. Please read description carefully.
$19.00
Bestseller No. 2
Ishihara Colour Vision Test Book for Color Deficiency 24 Plates with User Manual
Ishihara Colour Vision Test Book for Color Deficiency 24 Plates with User Manual
Diagnostic plates: intended to determine the type of color vision defect; Ishihara Test Chart Books for Color Deficiency 24 Plates with usar manual
$30.00
Bestseller No. 4
NCE Visual Study Guide & Activity Book by Lindsay Braman - Spiral-Bound Test Prep for National Counselor Exam & CPCE - Illustrated Interactive Studying to Engage Creative, Neurodiverse, & ADHD Minds.
NCE Visual Study Guide & Activity Book by Lindsay Braman - Spiral-Bound Test Prep for National Counselor Exam & CPCE - Illustrated Interactive Studying to Engage Creative, Neurodiverse, & ADHD Minds.
Full size 8.5x11, spiral-bound for lie-flat studying.; Printed on premium, 80lb textured paper you can color and highlight with no bleed.
$48.99

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Read next

Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.