October DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsPC HealthRecommendedCrashes, freezes, slowdowns? Check your PC nowSpot repairable issues before they interrupt work.Check PCOctober DealsAmazon USDeal season is back - check today's better picksAmazon US: current deals, useful picks and tech finds.See Picks×
Skip to content
World desk6 min

How to Test a Website’s HTTP Response and Availability

Check a website’s HTTP status with curl, distinguish a momentary response from ongoing availability, and troubleshoot common DNS, connection, TLS, and content-check failures.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

To check a website’s HTTP response, send a request to the exact URL and inspect its status code and headers. From a terminal, run curl -svo /dev/null https://example.com/, replacing the URL with the one you want to test. That gives you a point-in-time view from your computer and network; for ongoing availability, use a recurring monitor with alerts and checks that validate the expected response.

Check a URL’s HTTP response with curl

curl sends an HTTP request without relying on browser rendering, making it useful for checking status, headers, and connection behavior. Cloudflare recommends it for troubleshooting HTTP requests, measuring performance, inspecting headers, and comparing its proxy response with an origin response (Cloudflare’s HTTP troubleshooting guide).

  1. Use the exact URL. Include the scheme (http:// or https://), hostname, and path that you need to test. To check the secure endpoint and its TLS connection, use the HTTPS URL.
  2. Run the request. For example: curl -svo /dev/null https://example.com/. This displays request and response details while discarding the response body. Substitute the site you are checking.
  3. Read the result. Note the HTTP status code and response headers. If the status or headers are unexpected, repeat the request without discarding the body—remove -o /dev/null—to see whether the page contains an application error or other useful diagnostic detail.
  4. Retest when the result matters. One successful request only shows what happened from that client and network at that moment. It does not establish continuous availability.

What the response does—and does not—tell you

A response can be technically successful while the page is wrong, incomplete, or showing an application-level error. Check the body when you need to confirm what the server actually returned. A browser may also behave differently from a direct request because it renders the page and can be affected by client-side scripts or browser state.

Choose a test that matches the question

What you need to know Method What it establishes Important limitation
Did this URL respond just now? curl from a terminal The response received by that client on that network One observation at one point in time
Is a proxy or CDN behaving differently from the origin? Compare a public request with an authorized direct-origin request Whether the error differs between the public edge and origin Requires access to the origin and correct connection details
Is the website available over time, and should I be alerted? A recurring HTTP/HTTPS uptime check, preferably from multiple locations Repeated reachability against configured success criteria A status-only check may miss incorrect page content
Can Google access this page? Search Console URL Inspection live test Google’s test of access and indexing-related signals Does not prove general visitor availability or guarantee search appearance

Diagnose a proxy, CDN, or origin failure

If a public request fails and you operate the site or otherwise have authorization, compare it with a request that reaches the origin directly. Cloudflare documents the curl --connect-to option for testing an origin while retaining the requested hostname. The exact command depends on the site’s origin address and configuration; do not guess those details or bypass access controls. If there are multiple origin servers, test each one because their responses may differ. See Cloudflare’s troubleshooting guide.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
#1 Best Overall
Sale
TP-Link AX1800 WiFi 6 Router (Archer AX21 V5)
  • DUAL-BAND WIFI 6 ROUTER: Wi-Fi 6(802.11ax) technology achieves faster speeds, greater capacity and reduced network congestion compared to the previous gen. All WiFi routers require a separate modem. Dual-Band WiFi routers do not support the 6 GHz band.
  • AX1800: Enjoy smoother and more stable streaming, gaming, downloading with 1.8 Gbps total bandwidth (up to 1200 Mbps on 5 GHz and up to 574 Mbps on 2.4 GHz). Performance varies by conditions, distance to devices, and obstacles such as walls.
  • CONNECT MORE DEVICES: Wi-Fi 6 technology communicates more data to more devices simultaneously using revolutionary OFDMA technology
  • EXTENSIVE COVERAGE: Achieve the strong, reliable WiFi coverage with Archer AX1800 as it focuses signal strength to your devices far away using Beamforming technology, 4 high-gain antennas and an advanced front-end module (FEM) chipset
  • OUR CYBERSECURITY COMMITMENT: TP-Link is a signatory of the U.S. Cybersecurity and Infrastructure Security Agency’s (CISA) Secure-by-Design pledge. This device is designed, built, and maintained, with advanced security as a core requirement.

If the public endpoint fails but the authorized origin responds as expected, investigate the proxy or edge path. If both fail, investigate the origin and its dependencies. This comparison helps locate a fault; it does not by itself identify the underlying cause.

Monitor availability over time

For an outage question, a manual request is a snapshot, not a monitoring plan. A managed uptime check can send HTTP, HTTPS, or TCP probes periodically, use more than one location, retain check history, and trigger alerts. When comparing monitoring options, look at probe locations and frequency, redirect handling, accepted status codes, TLS checks, alerting, and response-body validation.

Validate the response, not just the status

Google Cloud’s HTTP/HTTPS uptime checks require a 2xx status by default and do not inspect the response body unless you configure validation. The service can be configured to accept additional status codes or check response payloads using strings, regular expressions, or JSON paths (Google Cloud uptime checks; response validation options).

For example, a check that only accepts a 2xx response may miss an application error page returned with a successful status. Add a body check for a stable marker that should appear on the healthy page. Choose a marker that is unlikely to change during ordinary page updates, and update the check if the site’s response format changes.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #2
Sale
TP-Link BE6500 Dual-Band WiFi 7 Router (BE400)
  • 𝐅𝐮𝐭𝐮𝐫𝐞-𝐑𝐞𝐚𝐝𝐲 𝐖𝐢-𝐅𝐢 𝟕 - Designed with the latest Wi-Fi 7 technology, featuring Multi-Link Operation (MLO), Multi-RUs, and 4K-QAM. Achieve optimized performance on latest WiFi 7 laptops and devices, like the iPhone 16 Pro, and Samsung Galaxy S24 Ultra.
  • 𝟔-𝐒𝐭𝐫𝐞𝐚𝐦, 𝐃𝐮𝐚𝐥-𝐁𝐚𝐧𝐝 𝐖𝐢-𝐅𝐢 𝐰𝐢𝐭𝐡 𝟔.𝟓 𝐆𝐛𝐩𝐬 𝐓𝐨𝐭𝐚𝐥 𝐁𝐚𝐧𝐝𝐰𝐢𝐝𝐭𝐡 - Achieve full speeds of up to 5764 Mbps on the 5GHz band and 688 Mbps on the 2.4 GHz band with 6 streams. Enjoy seamless 4K/8K streaming, AR/VR gaming, and incredibly fast downloads/uploads.
  • 𝐖𝐢𝐝𝐞 𝐂𝐨𝐯𝐞𝐫𝐚𝐠𝐞 𝐰𝐢𝐭𝐡 𝐒𝐭𝐫𝐨𝐧𝐠 𝐂𝐨𝐧𝐧𝐞𝐜𝐭𝐢𝐨𝐧 - Get up to 2,400 sq. ft. max coverage for up to 90 devices at a time. 6x high performance antennas and Beamforming technology, ensures reliable connections for remote workers, gamers, students, and more.
  • 𝐔𝐥𝐭𝐫𝐚-𝐅𝐚𝐬𝐭 𝟐.𝟓 𝐆𝐛𝐩𝐬 𝐖𝐢𝐫𝐞𝐝 𝐏𝐞𝐫𝐟𝐨𝐫𝐦𝐚𝐧𝐜𝐞 - 1x 2.5 Gbps WAN/LAN port, 1x 2.5 Gbps LAN port and 3x 1 Gbps LAN ports offer high-speed data transmissions.³ Integrate with a multi-gig modem for gigplus internet.
  • 𝐎𝐮𝐫 𝐂𝐲𝐛𝐞𝐫𝐬𝐞𝐜𝐮𝐫𝐢𝐭𝐲 𝐂𝐨𝐦𝐦𝐢𝐭𝐦𝐞𝐧𝐭 - TP-Link is a signatory of the U.S. Cybersecurity and Infrastructure Security Agency’s (CISA) Secure-by-Design pledge. This device is designed, built, and maintained, with advanced security as a core requirement.

HTTP(S) checks in Google Cloud follow redirects and evaluate the final response against the configured criteria. That can be useful when a site redirects visitors to its canonical host, but make sure the final destination is the one you intend to monitor.

Check whether Google can fetch a page

Use Search Console’s URL Inspection tool when the question is specifically whether Google can access a page. For a property you own, run its live test to inspect Google’s fetch and access-related information, including response details such as HTTP headers.

Keep the live test separate from the indexed report: the indexed view describes Google’s last indexed version and can be stale. A successful live test indicates access under Google’s test conditions; it does not prove the page is available to every visitor or promise that it will appear in search results. Also distinguish crawl access from indexing directives: a page can be fetchable but disallowed from indexing, for example by a noindex directive.

Understand common failure signals

A failed request is not enough to conclude that the entire website is down. Search Console’s documented live-test failure categories include DNS problems, connection failures, invalid or truncated server responses, invalid SSL certificates, an unreachable robots.txt file, and host capacity problems (Search Console URL Inspection documentation).

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #3
TP-Link AC1200 Gigabit Dual Band WiFi Router (Archer A6)
  • Dual band router upgrades to 1200 Mbps high speed internet (300mbps for 2.4GHz plus 900Mbps for 5GHz), reducing buffering and ideal for 4K stream
  • Full Gigabit Ports - Gigabit Router with 4 Gigabit LAN ports, ideal for any internet plan and allow you to directly connect your wired devices
  • Boosted Coverage - Four external antennas equipped with Beamforming technology extend and concentrate the Wi-Fi signals
  • MU-MIMO technology - (5GHz band) allows high speeds for multiple devices simultaneously
  • Access Point Mode - Supports AP Mode to transform your wired connection into wireless network, an ideal wireless router for home
  • DNS server unresponsive or host unknown: the hostname could not be resolved under the test conditions. Check the hostname and DNS configuration, then retest.
  • Connection refused, unreachable, or otherwise failing: the client could not establish the connection. Check the service, network path, firewall, and—if applicable—the proxy-to-origin path.
  • Invalid or truncated response: the server did not return a complete, valid response. Inspect the server or intermediary logs and compare public and authorized origin responses.
  • Invalid SSL certificate: the HTTPS endpoint’s certificate was not accepted by the test. Check certificate validity and the hostname covered by the certificate.
  • robots.txt unreachable or host load exceeded: Google’s test could not retrieve the crawl-control file or the host could not handle the load. These are distinct from a simple status-code failure.

Server errors can be transient: Search Console notes that a failure may occur in one live test but not another. Repeat the test and, when availability matters, compare observations from another network or a recurring monitor before treating one result as a sustained outage.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Or skip the browser setup

If your goal is to capture how a page looks rather than diagnose its HTTP response, ScreenshotNeo offers a website screenshot API and MCP server for developers. It does not replace curl or an uptime monitor: a screenshot shows rendered output, not a history of availability or a substitute for inspecting response headers.

One GET request can return a screenshot or PDF. For example, using the supplied cURL pattern with the URL you want to capture:

curl -G "https://api.screenshotneo.com/v1/shot" -d access_key=YOUR_API_KEY --data-urlencode url=https://example.com -o shot.webp

See the ScreenshotNeo API documentation for request options. Before a capture, it can accept cookie or consent banners and remove more than 60 known consent platforms, newsletter popups, and chat widgets; each step can be turned off. Bot checks and CAPTCHAs, blank pages, timeouts, failed loads, and cache hits are not billed, and responses indicate the page verdict and billing status. Its MCP server provides take_screenshot, get_page_info, and capture_pdf tools for AI agents using Claude, Cursor, or another MCP client.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The free plan includes 1,000 screenshots a month with no card; paid plans start at $5 for 3,000. Sign up for ScreenshotNeo to try it free.

Rank #4
Sale
TP-Link AC1200 WiFi Router Dual Band Wireless Internet Router (Archer A54)
  • Dual-band Wi-Fi with 5 GHz speeds up to 867 Mbps and 2.4 GHz speeds up to 300 Mbps, delivering 1200 Mbps of total bandwidth¹. Dual-band routers do not support 6 GHz. Performance varies by conditions, distance to devices, and obstacles such as walls.
  • Covers up to 1,000 sq. ft. with four external antennas for stable wireless connections and optimal coverage.
  • Supports IGMP Proxy/Snooping, Bridge and Tag VLAN to optimize IPTV streaming
  • Access Point Mode - Supports AP Mode to transform your wired connection into wireless network, an ideal wireless router for home
  • Advanced Security with WPA3 - The latest Wi-Fi security protocol, WPA3, brings new capabilities to improve cybersecurity in personal networks

Frequently Asked Questions

Does a 200 status code prove that a website is working?

No. It confirms a successful HTTP status for that request, but the body may still contain an application error or incomplete content. Check the response body or configure a monitor to validate expected content.

Why does a website load for me but fail in a monitor or Search Console?

The checks may use different networks, locations, clients, or test conditions. Compare the exact URL and time of each result, then retest from another network or with recurring checks.

Does a successful Search Console live test mean the page will rank?

No. It tests access and indexing-related signals under Google’s test conditions; it does not guarantee search appearance or placement.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Quick Recap

SaleBestseller No. 1
TP-Link AX1800 WiFi 6 Router (Archer AX21 V5)
TP-Link AX1800 WiFi 6 Router (Archer AX21 V5)
VPN SERVER: Archer AX21 Supports both Open VPN Server and PPTP VPN Server
$59.98
Bestseller No. 3
TP-Link AC1200 Gigabit Dual Band WiFi Router (Archer A6)
TP-Link AC1200 Gigabit Dual Band WiFi Router (Archer A6)
MU-MIMO technology - (5GHz band) allows high speeds for multiple devices simultaneously
$44.99
SaleBestseller No. 4
TP-Link AC1200 WiFi Router Dual Band Wireless Internet Router (Archer A54)
TP-Link AC1200 WiFi Router Dual Band Wireless Internet Router (Archer A54)
Supports IGMP Proxy/Snooping, Bridge and Tag VLAN to optimize IPTV streaming
$24.32

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Shenzhen desk3 min
    HONOR Expands Beyond Smartphones With Humanoid Robot RevealHONOR said it unveiled its first humanoid robot at MWC 2026 and named shopping assistance, workplace inspections, and supportive companionship as intended uses. Later Robotics D1 claims and a reported…
Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.