October DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsClean PCRecommendedOne scan can reveal what keeps slowing WindowsLook for cleanup and repair opportunities.Run ScanOctober DealsAmazon USDeal season is back - check today's better picksAmazon US: current deals, useful picks and tech finds.See Picks×
Skip to content
World desk5 min

How to Wait for a Web Page to Finish Loading Before PageCrawl.io Captures It

Use PageCrawl.io's pre-capture actions to wait for the content your monitor needs, not just a browser loading milestone.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

In PageCrawl.io, edit the monitored page, add an action before capture, and wait for a marker that indicates the content you track is ready. Use Wait for text or Wait for element for dynamic results; for lazy-loaded content, use Scroll to bottom followed by a brief Wait. A fixed pause or generic network-idle signal can finish before the specific content you need appears.

Set a pre-capture wait in PageCrawl.io

PageCrawl.io actions run in the browser before a snapshot and execute in the order shown. Configure them on the monitored page, in the sequence needed to make its tracked content available. The Help Center describes actions as tasks PageCrawl executes before taking a page snapshot (Perform Actions: Automate Browser Interactions Before Monitoring, last updated September 16, 2026).

As an Amazon Associate I earn from qualifying purchases.

  1. Open the monitored page and click Edit.
  2. Find Actions, click Add Action, and choose the needed action.
  3. For content that arrives asynchronously, choose Wait for text and enter a stable phrase that appears when results are ready. Alternatively, choose Wait for element and provide a CSS selector or XPath for the relevant content.
  4. For content revealed by scrolling, add Scroll to bottom, then add Wait. PageCrawl.io suggests 2–3 seconds as an example; tune the pause to the page rather than treating it as a guarantee.
  5. Save the sequence and inspect a capture to confirm that the marker appears and the actions run in the intended order.

PageCrawl.io documents Wait for text and Wait for text to disappear as waiting up to 15 seconds. A missing marker may mean the page did not finish, the phrase changed, or the action is looking for the wrong content; a longer wait cannot correct a bad marker.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Choose a readiness signal that matches the page

Page behavior Use Reason
Results appear after an API request Wait for a unique result heading, status phrase, or result element It waits for the output being monitored rather than an arbitrary duration.
A loading message disappears Wait for text to disappear It ties readiness to the end of a visible loading state; the documented wait is up to 15 seconds.
Images or rows load as the page is scrolled Scroll to bottom, then Wait briefly This gives scroll-triggered content a chance to load and render.
Several clicks, state changes, or conditional waits are needed Custom JavaScript action It can sequence interactions that the built-in actions cannot express.

Prefer a content-specific marker over a fixed delay whenever the page exposes a stable one. If no marker exists, a short pause after the relevant interaction can help, but it is inherently less reliable: slow responses may outlast it, while fast ones make it longer than necessary.

#1 Best Overall
CanaKit Raspberry Pi 5 Starter Kit PRO - Turbine Black (128GB Edition) (8GB RAM)
  • Includes Raspberry Pi 5 with 2.4Ghz 64-bit quad-core CPU (8GB RAM)
  • Includes 128GB Micro SD Card pre-loaded with 64-bit Raspberry Pi OS, USB MicroSD Card Reader
  • CanaKit Turbine Black Case for the Raspberry Pi 5
  • CanaKit Low Noise Bearing System Fan
  • Mega Heat Sink - Black Anodized

Use custom JavaScript for multi-step loading

PageCrawl.io custom JavaScript runs in the page browser context as part of the action sequence before tracked elements are extracted. Its return value is ignored, so use it for side effects such as clicking a load-more button or waiting for content to render. The following pattern is adapted from PageCrawl.io’s documented example:

(async () => {
  const sleep = ms => new Promise(resolve => setTimeout(resolve, ms));
  document.querySelector('#load-more')?.click();
  await sleep(800);
  document.querySelector('#load-more')?.click();
  await sleep(800);
})();

The 800 ms intervals are illustrative, not a universal setting. If a visible content condition can be checked, use that rather than assuming every click finishes in the same time. The custom JavaScript action has a documented 30-second safety timeout, so keep the sequence bounded (PageCrawl.io custom JavaScript documentation).

Rank #2
CanaKit Raspberry Pi 5 16GB Starter Kit PRO - Turbine Black (128GB Edition) (16GB RAM)
  • Includes Raspberry Pi 5 16GB with 2.4Ghz 64-bit quad-core CPU (16GB RAM)
  • Includes 128GB Micro SD Card pre-loaded with 64-bit Raspberry Pi OS, USB MicroSD Card Reader
  • CanaKit Turbine Black Case for the Raspberry Pi 5
  • CanaKit Low Noise Bearing System Fan
  • Mega Heat Sink - Black Anodized

PageCrawl.io also documents overall check timeouts of 45 seconds on Free, 90 seconds on Standard, and 180 seconds on Enterprise and Ultimate. These are maximum limits, not promises that a slow page will complete successfully (PageCrawl.io troubleshooting documentation). Keep action waits comfortably inside the applicable check limit so navigation and other work have time to run.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Why “page loaded” can be the wrong test

A browser lifecycle event or quiet network does not necessarily mean an application has rendered the particular result being monitored. In Playwright, commit means a response was received and document loading started; domcontentloaded and load refer to browser events. Playwright defines networkidle as no network connections for at least 500 ms, but discourages using it as a test-readiness condition and recommends assertions instead (Playwright Page API).

Rank #3
CanaKit Raspberry Pi 5 Essentials Starter Kit (4GB RAM)
  • CanaKit Raspberry Pi 5 Essentials Starter Kit

For browser automation you control, wait for navigation using an appropriate lifecycle condition, then assert that the needed content exists. Puppeteer likewise offers waitForFunction to wait until a page-context condition becomes true, as well as waitForNetworkIdle; the former can express application-level readiness when the predicate reflects the actual content (Puppeteer Page API).

Troubleshoot captures that still miss content

  • The wait times out: Inspect the captured page and check whether the site responded slowly or failed temporarily. Verify that the phrase or selector appears on that page in the state PageCrawl.io sees. Increase a delay only if the content does eventually appear and there is no better readiness marker.
  • The selector is not found: The page structure may have changed, the selector may target the wrong element, or the element may not yet exist. Review the current page and update the CSS selector or XPath; do not treat this as automatically being a network delay.
  • The capture shows a loading state: Wait for the final result or for the loading text to disappear. For scroll-triggered content, put the scroll action before the wait and verify the expected content is present.
  • The result is 401: The page may require authentication. A wait does not log in or grant account permissions.
  • The result is 403: Access was refused. Extending the wait or changing a connection does not itself grant permission.
  • The site presents a bot check or access block: This is an access problem rather than proof that the wait is too short. Inspect the capture and handle access through an authorized method.
  • The JavaScript action runs too long: Reduce the number of interactions or replace repeated sleeps with a bounded condition check. The custom JavaScript safety timeout is 30 seconds, and the overall check has its own plan limit.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Or skip the browser setup

If you need a screenshot rather than a PageCrawl.io monitoring rule, ScreenshotNeo can capture a URL with one API request. Its capture options include waiting for a selector, a delay, or network idle, along with full-page capture and element-by-CSS-selector capture. Cookie banners, popups, and chat widgets are removed before the shot; bot checks, blank pages, and failed loads are never billed. It also has an MCP server for AI agents, including Claude, Cursor, and other MCP clients. The free plan includes 1,000 screenshots a month with no card; paid plans start at $5 for 3,000.

Example cURL request (replace the URL with the page you want to capture):

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #4
SANOOV Raspberry Pi 5 4GB Kit, 4GB RAM Single Board Computer with Active Cooler and ABS Case, Complete Raspberry Pi 5 Starter Kit for IoT Robotics Retro Gaming
  • All-in-One Complete Kit: This SANOOV RPi 5 bundle comes with Raspberry Pi 5 4GB RAM single board, active cooler, durable ABS case and screwdriver. No extra parts needed, ready to use right out of the box for beginners and hobbyists
  • Powerful Single Board Computer: Equipped with 4GB RAM and high-performance processor, delivers fast running speed for 4K playback, AI projects, programming and daily computing tasks. SANOOV for raspberry pi 5 4GB is equipped with broadcom 64 quad-core Arm Cortex A76 processor with gigabit ethernet and upgraded with IEEE 802.11ac Wi-Fi, Bluetooth 5.0 dual-band 2.4Ghz and 5Ghz and Power Over Ethernet (POE). Upgrading delivers 2-3 x speed vs Pi 4, redefining the experience
  • Efficient Active Cooler: Effectively lowers operating temperature and prevents performance throttling. Runs quietly even under long-time heavy load, ensures stable operation all day long. SANOOV RPi 5 4GB kit offer an active cooler, which combines an aluminium heatsink with a high-performance PWM fan. Active cooler is fully compatible with the Pi OS, which can effectively reduce the temperature of RPi5 and ensure its good performance during long-term high load operation
  • Sturdy ABS Protective Case: Well-fitted for Raspberry Pi 5 board, can be secured with 4 screws to effectively protect the Pi 5 motherboard from damage, reserves full access to all ports and buttons. SANOOV uses ABS material to produce the case, which has a softer texture and feel. Meanwhile, SANOOV case adopts a layered design for easy disassembly and installation. (Tip: The Case cannot install M.2 HAT Add on Board and Solid State Drive!)
  • Wide Application & Full Compatibility: Seamlessly compatible with official OS and mainstream peripheral accessories for Raspberry Pi 5. Whether you are a beginner, student, electronics hobbyist or professional developer, this all-in-one kit meets your diverse needs. It excels in IoT projects, robotics design, retro gaming devices, home media servers and other DIY creations. Backed by a large global community, you can easily find guides, technical support and shared projects online
curl -G "https://api.screenshotneo.com/v1/shot" -d access_key=YOUR_API_KEY --data-urlencode url=https://stripe.com -o shot.webp

See the ScreenshotNeo API documentation for authentication and capture options. Sign up for 1,000 free screenshots a month, with no card required.

Quick Recap

Bestseller No. 1
CanaKit Raspberry Pi 5 Starter Kit PRO - Turbine Black (128GB Edition) (8GB RAM)
CanaKit Raspberry Pi 5 Starter Kit PRO - Turbine Black (128GB Edition) (8GB RAM)
Includes Raspberry Pi 5 with 2.4Ghz 64-bit quad-core CPU (8GB RAM); CanaKit Turbine Black Case for the Raspberry Pi 5
$259.95
Bestseller No. 2
CanaKit Raspberry Pi 5 16GB Starter Kit PRO - Turbine Black (128GB Edition) (16GB RAM)
CanaKit Raspberry Pi 5 16GB Starter Kit PRO - Turbine Black (128GB Edition) (16GB RAM)
Includes Raspberry Pi 5 16GB with 2.4Ghz 64-bit quad-core CPU (16GB RAM); CanaKit Turbine Black Case for the Raspberry Pi 5
$419.99
Bestseller No. 3
CanaKit Raspberry Pi 5 Essentials Starter Kit (4GB RAM)
CanaKit Raspberry Pi 5 Essentials Starter Kit (4GB RAM)
CanaKit Raspberry Pi 5 Essentials Starter Kit
$189.99
Best Value
RasTech Raspberry Pi 5 8GB Kit with Active Cooler and Pi5 Case
  • 【What you Get】You will get 1*Pi 5 8GB Single Board,1*RasTech Case,1*Active Cooler,1*Screwdriver,1*Installation instructions,12-month free warranty, lifetime service, 24-hour prompt and friendly response.
  • 【More Connectors】There are two USB 3.0 ports(5Gbps simultaneously) and two USB 2.0 ports, which triple total bandwidth ,support any combination of up to two cameras or displays. Peak SD card performance is doubled through support for the SDR104 high-speed mode. It provides a smooth desktop experience for you. Offer Gigabit Ethernet and a PCIe interface, along with dual-band Wi-Fi and Bluetooth 5.0/BLE wireless capability. The RasTech Pi 5 Kit use the new 27W 5.1V 5A USB-C power connector.
  • 【 Support Dual 4Kp60 Display 】Each of the two microHDMI sockets can control a 4K display at 60 Hertz, now support HDR, offering super HD video for media streaming projects. RPi 5 is the first RPi model that comes with a PCI Express port (PCIe 2.0 x1 with 500 MB/s) to attach SSDs (requires separate M.2 HAT).
  • 【 Excellent Chips And Applications】Pi 5 is a full-size Pi computer using silicon built in-house at Pi. The RP1 “southbridge” provides the bulk of the I/O capabilities for Pi 5. Pi 5 is more friendly and convenient in the development of Internet of Things, Web development, machine identification, automatic control and other electronic equipment applications and network.
  • 【 Faster CPU, Better GPU 】 Pi 5 features a Broadcom BCM2712 64-bit quad-core Arm Cortex-A76 processor running at 2.4GHz, it delivers a 2–3× increase in CPU performance relative to RaspberryPi 4. The 800MHz VideoCore VII GPU is compatible to OpenGL ES 3.1 and Vulkan 1.2, substantial uplift in graphics performance. Pi 5 Offers lightning-fast CPU speed, a PCI Express interface, a Real Time Clock (RTC) and a power button and runs significantly cooler than Pi 4.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Windows Errors? Fix Them Before They SpreadFree repair scan
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.