Recommended Free Tools
Use noindex when a page should stay accessible to visitors but should not appear in search results. If Google crawls a page intended to rank and processes a noindex directive, it excludes that page from Google Search. That is a page-level visibility effect, not evidence of a sitewide ranking penalty.
What does noindex do?
noindex tells a supported search engine not to include the crawled page or resource in its search results. For Google, the instruction can be delivered in an HTML robots meta tag or an HTTP X-Robots-Tag response header. Google has to fetch the URL and read the directive before it can act on it.
As an Amazon Associate I earn from qualifying purchases.
For an HTML page, the meta tag can look like this:
<meta name="robots" content="noindex">For resources such as PDFs, videos, or images, use an HTTP response header when an HTML meta tag is not available:
Do these 3 things before closing this tab:
1Scan for outdated or missing drivers - takes under a minute2Clear out junk files and repair common Windows errors3Fix the driver behind crashes, sound loss and screen glitchesX-Robots-Tag: noindexGoogle’s noindex documentation explains both methods and the need for the crawler to access the page.
#1 Best Overall
When should you use noindex?
Use it for a URL that should remain publicly reachable but has no reason to be listed in search results. Examples might include a publicly accessible utility page or a page whose audience arrives through a direct link rather than search. The decision is about whether that particular page belongs in search, not whether a site should rank generally.
- Choose
noindexwhen visitors should still be able to open the URL but it should not appear in search results. - Choose password protection when access itself should be restricted.
- Remove the resource when it should no longer be available at all.
These controls serve different goals; noindex is not an access-control mechanism.
Rank #2
Noindex vs. robots.txt vs. nofollow
| Control | What it controls | Important caveat |
|---|---|---|
noindex meta tag or X-Robots-Tag |
Whether a crawled page or resource is shown in results | The crawler must fetch the URL to read the instruction. |
robots.txt disallow |
Whether crawlers can request URLs | It is not a reliable way to keep a URL out of search; a blocked URL may still be indexed if other pages link to it. |
nofollow |
Whether Google should follow links from a page | It does not mean the page itself should be excluded from results. |
| Password protection or resource removal | Whether people can access the resource, or whether it exists | Use these when the goal is access restriction or removal rather than public access without search listing. |
Google describes robots.txt as a way to manage crawler access, not as a deindexing directive. The distinctions here describe Google’s published behavior; individual search engines may interpret directives differently.
Free tools Windows power users keep installed
One-click scans. No signup required.
Why can noindex remove a page that should rank?
If Google processes noindex on an intended landing page, that page is excluded from Google Search and loses its search visibility. A common cause is a directive added to a shared site template or HTTP configuration that also affects pages meant to rank. This can affect many URLs, but it should not be described as a general sitewide ranking penalty: the documented effect is exclusion of pages on which Google sees the directive.
Before changing a template or server header, check which URLs receive the instruction. A mistake can affect more than the one page you meant to hide.
Why is a page still indexed after noindex?
Google must recrawl the URL to see the directive. If the URL is blocked in robots.txt, or otherwise inaccessible to Googlebot, the crawler may not be able to read the tag or header. Google warns that a blocked URL can still appear in results, for example when other pages link to it. In other words, combining noindex with a crawl block can prevent the very instruction you want Google to process.
Rank #4
Even when the page is crawlable, removal is not necessarily immediate. Google says a page that still appears may not have been recrawled since the directive was added; for some pages, it may take months for Googlebot to revisit them.
How to check and fix a noindex issue
- Inspect the affected URL in Search Console. Use the URL Inspection tool to check what Google knows about the URL and whether it has processed the current page.
- Check the directive Googlebot receives. For HTML, inspect the robots meta tag. For non-HTML resources, check the HTTP response headers for
X-Robots-Tag. - Check crawl access. Make sure
robots.txtor another access restriction is not preventing Googlebot from fetching the URL before it can see the directive. - Review affected URLs in the Page Indexing report. Look for URLs that Google reports as having a
noindexdirective, especially if the issue may come from a shared template or header. - Correct the rule and allow another crawl. If the page should rank, remove the unintended directive and ensure Googlebot can access it. Use URL Inspection to request a recrawl; Google does not promise a fixed restoration schedule.
Google’s guidance is in its noindex troubleshooting documentation. A recrawl request is not a guarantee of immediate indexing.
Does noindex hurt SEO?
It can remove a page’s search visibility if the page should have appeared in results and Google processes the directive. That is the direct consequence to assess. The Google documentation cited here does not establish that using noindex creates a broader sitewide ranking penalty, nor does it quantify a ranking-loss percentage.
Quick Recap
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
