What’s actually slowing this PC down?
Pick the symptom - the matching free tool is one click away.
Google handles a web page in three distinct stages: crawling discovers and fetches its URL, indexing analyzes and may store the page, and ranking determines whether it is a useful result for a particular search. A page can pass one stage and not the next: being crawled does not guarantee index inclusion, and being indexed does not guarantee that it will appear for a query.
What happens at each stage?
Crawling: Google discovers and fetches a URL
Google does not maintain a central registry of every web page. It can learn a URL from links on pages it already knows, from URLs it has visited before, or from a sitemap. Googlebot may then fetch it. Google’s systems decide which sites to crawl, how often, and how many pages to request, taking site responses and the need to avoid overloading servers into account. Crawling can also involve rendering a page and running its JavaScript. Google’s guide to how Search works explains this discovery and crawling process.
As an Amazon Associate I earn from qualifying purchases.
Access affects whether Googlebot can fetch a page. A robots.txt rule, login requirement, network problem, or server error can block or limit access. A sitemap can help Google find URLs, but it does not compel Google to crawl them.
Crashes, No Sound, or Screen Glitches?
Random freezes, missing sound and display glitches usually trace back to one bad driver. Find and replace yours safely.Free scan · under a minutePC Slower Than It Used to Be?
A free scan shows the junk files, broken settings and background clutter dragging Windows down - then fixes them in one click.Free scan · Windows 10 & 11Indexing: Google analyzes the page and decides whether to include it
After fetching a page, Google analyzes its text, relevant page attributes, and media. It also looks for duplicates and may group similar URLs, then choose a canonical URL—the version it treats as the representative. Signals such as HTTPS, redirects, sitemap inclusion, and rel="canonical" annotations can inform that choice, but Google makes the final decision. Its canonicalization guidance describes how duplicate URLs are handled.
#1 Best Overall
Processing a page does not mean it will be indexed. Google identifies low-quality content, noindex directives, and technical or design obstacles as possible reasons a page may not be included. The directives for crawling and indexing are different: robots.txt controls crawler access, while noindex tells Google not to index content. Blocking a URL in robots.txt does not, by itself, guarantee that the URL will be excluded from Search.
Ranking and serving: Google chooses results for a query
When someone searches, Google looks through its index for pages that match the query and serves the results it considers relevant and high quality. Ranking systems use many factors, and what appears can vary with context such as the searcher’s location, language, and device. Google describes this stage and its ranking systems in its Search Central documentation. It says ranking is programmatic and that it does not accept payment to rank pages higher.
Index status answers whether Google has included a page in its index; it does not promise visibility for a particular search. A page may be indexed but not shown for a target query if Google considers it less relevant or lower quality than alternatives, or if other serving rules apply.
Do these 3 things before closing this tab:
1Scan for outdated or missing drivers - takes under a minute2Repair Windows errors before they cause bigger problems3Fix the driver behind crashes, sound loss and screen glitchesHow to diagnose what is happening to a page
Start with the symptom, then investigate the corresponding stage. Search Console’s URL Inspection tool can help examine an individual URL, while crawl troubleshooting guidance covers availability, URLs Google is not crawling, crawl efficiency, and overcrawling.
| What you observe | Stage to investigate | Useful checks |
|---|---|---|
| Google appears not to know the URL | Discovery and crawling | Check links from pages Google knows, sitemap submission, URL Inspection, and server access or logs. |
| Googlebot cannot fetch the URL | Crawling and access | Check robots.txt, login or network restrictions, server errors, and site availability. |
| The URL was fetched but is absent from the index | Indexing | Check for noindex directives, duplicate or canonical selection, content quality, and technical accessibility. |
| The URL is indexed but does not appear for a target search | Ranking and serving | Assess relevance and usefulness for that query, quality, the selected canonical URL, and query context. |
Google’s crawl troubleshooting guide and crawling and indexing FAQ provide additional checks. A sitemap or a request to recrawl can help Google discover or revisit a URL, but neither guarantees that Google will crawl it at a particular time, index it, or show it in results. Google explicitly says it does not guarantee that it will crawl, index, or serve a page, even when the page follows Search Essentials.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Why the distinction matters
Each stage answers a different question: crawling asks whether Google can find and fetch the URL; indexing asks whether Google has analyzed and included it, and which URL represents it; ranking asks whether that indexed content is a good result for a specific query. A fix aimed at the wrong stage may not address the problem—for example, requesting another crawl does not resolve a canonicalization issue, and index inclusion alone does not make a page relevant to every search.
Quick Recap
Best Value
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
