Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Use YouTube Studio’s built-in Test & Compare feature on a computer. Add up to three thumbnail variants to an eligible video, publish it, and let YouTube compare them concurrently using watch-time share. You can usually read a result after a few days, although some tests take up to two weeks.

What YouTube’s thumbnail test actually does

Test & Compare is YouTube’s native experiment for thumbnail images. It does not require a separate testing service or software subscription. You upload as many as three alternatives, and YouTube shows the options to viewers while measuring the share of watch time associated with each one.

This is different from choosing the image that gets the most clicks. A thumbnail can produce a click and still attract viewers who quickly leave because the image promised something the video does not deliver. YouTube says its watch-time approach is intended to identify thumbnails that help viewers understand the video and then continue watching. In YouTube’s words: “We believe that evaluating winning thumbnails by watch time share will best support creators’ growth.”

Eligibility and where to find the feature

Supported videos and channels

  • You must use YouTube Studio on a computer.
  • Your channel must have advanced features enabled.
  • The video must be a public long-form video or a podcast episode.
  • A Premiere can be tested after it ends and becomes a long-form video.

Private videos, videos marked Made for Kids, videos set for mature audiences, and Shorts are not eligible for this thumbnail experiment. To check access, open YouTube Studio and go to Settings → Channel → Feature eligibility.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
#1 Best Overall
Thumbnail Maker: Youtube Thumbnail & Banner Maker
  • Simple, accessible and beginner-friendly app
  • Select suitable dimensions for thumbnail or banner
  • Different categories of attractive backgrounds
  • Customization by adding text, overlay, and stickers
  • Different brands to make thumbnail more attractive

Thumbnail-only versus title-and-thumbnail testing

Test & Compare evaluates thumbnail images. YouTube documents a separate A/B test for combinations of titles and thumbnails, with up to three combinations. Do not assume that instructions for one experiment apply to the other; check the option presented for the specific video and confirm its current eligibility in Studio.

How to run Test & Compare

  1. Sign in to YouTube Studio on a computer.
  2. Select an existing video, or begin uploading a new one.
  3. In the video’s Thumbnail area, choose Test & compare.
  4. Upload up to three thumbnail files. Use two or three when you have meaningful alternatives; one image is not an experiment.
  5. Select Done.
  6. Publish the video. The experiment starts after publication.
  7. Return to Studio later to view the report.

You can stop a running test and select an image yourself with Stop & Set. That is useful when a time-sensitive video needs a deliberate choice before YouTube has enough data, but stopping early means you will not receive the complete comparison.

How to design useful variants

Change a clear hypothesis

Make each option different enough to test an editorial idea, such as a close-up face versus a product shot, a short benefit statement versus no text, or a bright background versus a dark one. This is practical testing guidance, not a YouTube guarantee. If every option changes the subject, wording, color, layout, and emotional expression at once, you may learn which complete package performed best but not which treatment caused the difference.

Keep the promise accurate

Every variant appears to viewers. Avoid sensational imagery, claims the video does not support, or a visual that implies a different subject. A high click rate from a misleading image is not a durable win when viewers leave quickly.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Prepare adequate resolution

Use the highest available resolution for every option. YouTube says that if any image in the experiment is below 720p (1280 × 720), all images in that experiment are downscaled to 480p (854 × 480). For standard video thumbnails, its general guidance recommends a 16:9 image in JPG or PNG format, as large as possible, with a recommended size of 3840 × 2160 pixels and a minimum width of 640 pixels.

The stated upload limit depends on the device: 2 MB on mobile and 50 MB on desktop for video thumbnails. Because limits and interface requirements can change, confirm the current requirement shown in Studio before exporting your final files.

Review policy before uploading

Check all alternatives against YouTube’s Community Guidelines. Thumbnail concerns include nudity or sexually provocative material, hate speech, violence, and harmful or dangerous content. YouTube also addresses misleading impersonation and other prohibited imagery. A violation can result in removal or a strike, so do not treat the experiment as a private draft: each option is shown to viewers.

Understanding the report

Winner

YouTube reports Winner when one thumbnail clearly outperformed the others on watch-time share and the result is statistically significant by YouTube’s standard.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Preferred

Preferred means one option probably performed better, but the evidence was not strong enough for YouTube to call it a confident winner. Use this as directional evidence rather than a guaranteed long-term advantage.

None

None means the options performed similarly and YouTube found no strong statistical difference. The first uploaded option remains the default unless you change it manually.

Why a test may not decide

  • The alternatives may be too similar to create a measurable difference.
  • The video may not receive enough impressions during the test.
  • Audience composition can change over time.
  • Normal experimental variation can produce a different outcome if you repeat the test later.

A non-winner result is normal. It does not prove that every image is equally effective in every future situation.

How long to wait

Plan for at least a few days, and allow up to two weeks in cases where the video receives impressions slowly. A result is not a performance benchmark or a promised uplift percentage; YouTube’s published figures describe the test’s operation, not a typical increase in views or watch time.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Do not stop solely because one option appears ahead during the first hours. Early viewers may not represent the broader audience, and a small initial sample can reverse direction. If the video has an urgent publication cycle, use Stop & Set only when the cost of waiting exceeds the value of completing the experiment.

Use Analytics without replacing the experiment

After publishing, YouTube Analytics can show thumbnail impressions, click-through rate, and watch time, including how impressions led to views and watch time. YouTube counts an impression when a thumbnail is shown for more than one second and at least 50% of it is visible. Impressions from some external sites and apps are excluded.

Use Analytics to understand distribution and the context around the result, but do not substitute CTR for the native outcome. Test & Compare chooses on watch-time share. A thumbnail with a higher CTR can still be the weaker option if its viewers watch less. Conversely, a small CTR difference may accompany a stronger watch-time result when the clicks are better matched to the video.

Native YouTube testing versus outside tools

YouTube’s experiment runs alternatives concurrently to an eligible audience and optimizes for watch-time share. An outside service may run sequential tests, use a different audience, or optimize for CTR alone. Those methods can legitimately disagree because they answer different questions and collect data at different times.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Use a third-party result as a separate signal, not as a direct confirmation of YouTube’s report. For a normal YouTube upload, the native feature is the simplest and most relevant starting point because it is attached to the video’s own distribution.

Or skip the browser setup

If you need image captures of thumbnail previews, landing pages, or approval screens rather than YouTube’s audience experiment, ScreenshotNeo provides a website screenshot API and MCP server. It removes cookie or consent banners, newsletter popups, and chat widgets before capture; bot checks, blank pages, failed loads, timeouts, and cache hits are not billed, and the response identifies the page and billing status in headers. Its MCP tools—take_screenshot, get_page_info, and capture_pdf—can be used by Claude, Cursor, or another MCP client.

A single cURL request is enough to capture a page preview:

curl -G "https://api.screenshotneo.com/v1/shot" -d access_key=YOUR_API_KEY --data-urlencode url=https://stripe.com -o shot.webp

See the ScreenshotNeo documentation for parameters and response details. The same request in Python is:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
import requests
r = requests.get("https://api.screenshotneo.com/v1/shot", params={"access_key": "YOUR_API_KEY", "url": "https://stripe.com"}, timeout=90)
open("shot.webp", "wb").write(r.content)

And in Node.js:

const q = new URLSearchParams({ access_key: 'YOUR_API_KEY', url: 'https://stripe.com' });
const res = await fetch(`https://api.screenshotneo.com/v1/shot?${q}`);

ScreenshotNeo supports full-page captures, CSS-selector element captures, device presets, custom viewports, retina scale, dark mode, PDF output, custom CSS and JavaScript, clicks before capture, hidden selectors, waits, request blocking, headers, cookies, user agents, authorization, timezone, geolocation, transparent backgrounds, resizing, TTL caching, signed links, asynchronous jobs, bulk capture for up to 100 URLs per call, usage data, and an OpenAPI specification. Every feature is included on every plan. The Free plan includes 1,000 screenshots per month with no card; paid plans start at $5 for 3,000 screenshots. Create a free ScreenshotNeo account.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Troubleshooting

“Test & compare” is missing

Check that you are on a computer, that advanced features are enabled, and that the video is public long-form content or an eligible podcast episode. Shorts, private videos, Made for Kids videos, and mature-audience videos do not qualify. Review Settings → Channel → Feature eligibility for access status.

Rank #4
Thumbnail Maker
  • 1. Pick a background from GALLERY, COLOR PALLETE or TRANSPARENT.
  • 2. You can add Text and stickers.
  • 3. You can apply filters
  • 4. You can change canvas size

The upload is rejected or looks soft

Confirm the file type, aspect ratio, dimensions, and device-specific size limit. Most importantly, ensure every variant is at least 1280 × 720; one smaller file can cause the full experiment set to be downscaled to 854 × 480.

The report says “None”

That means YouTube did not find a strong difference. Inspect whether the designs test a meaningful hypothesis and whether the video received enough impressions. Keep the first option, select another manually, or create a more distinct test for a later upload.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

CTR and the result disagree

This is possible and not automatically an error. CTR measures clicks from counted impressions, while the native experiment evaluates watch-time share. Examine watch time and viewer retention before deciding which signal answers your publishing goal.

The test is taking longer than expected

Wait up to two weeks when distribution is limited. A slow report does not indicate failure by itself. If timing matters more than additional evidence, use Stop & Set and choose the image manually.

A repeatable publishing checklist

  • Confirm the channel has advanced features.
  • Verify the video is eligible and will be public.
  • Create up to three policy-compliant 16:9 variants.
  • Keep every file at or above 1280 × 720.
  • Change a defined creative hypothesis rather than every element at once.
  • Start Test & Compare before publishing.
  • Allow days, and potentially two weeks, for the report.
  • Read Winner, Preferred, or None as the stated outcome.
  • Use Analytics for impressions, CTR, and watch time context.
  • Do not promise an uplift percentage that the test has not established.

Frequently Asked Questions

Can I test a YouTube thumbnail without publishing the video?

No. You upload the variants before publication, but the Test & Compare experiment starts only after the video is published.

How many thumbnail versions can I test?

YouTube allows up to three thumbnail options in the native thumbnail experiment.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Does Test & Compare work for Shorts?

No. Shorts are not eligible for this thumbnail experiment.

Is a “Preferred” result the same as a winner?

No. Preferred indicates a likely better option without enough statistical evidence for YouTube to call it a clear winner.

Quick Recap

Bestseller No. 1
Thumbnail Maker: Youtube Thumbnail & Banner Maker
Thumbnail Maker: Youtube Thumbnail & Banner Maker
Simple, accessible and beginner-friendly app; Select suitable dimensions for thumbnail or banner
$7.00
Bestseller No. 4
Thumbnail Maker
Thumbnail Maker
1. Pick a background from GALLERY, COLOR PALLETE or TRANSPARENT.; 2. You can add Text and stickers.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.