To scrape a small, defined set of data from a page you can access, use Puppeteer to open it, wait for the elements containing the data, and evaluate a function in the page to return only the fields you need. Check the site’s terms and applicable requirements first; public visibility and robots.txt do not, by themselves, authorize access.
What this Puppeteer workflow does
Puppeteer automates a browser: it can navigate to a page, interact with it, and read rendered content. The steps below are for collecting a limited set of fields from public pages—not for bypassing a login, CAPTCHA, block, or other access control. The examples use the Puppeteer 25.12.0 documentation as their reference; check the current documentation if you use a different version.
As an Amazon Associate I earn from qualifying purchases.
Install Puppeteer and define the data
Start by listing the exact fields and pages you need. Keep the collection narrow: extract the required values rather than saving full page HTML or unrelated personal information. Install Puppeteer in a Node.js project using its official getting-started instructions: Puppeteer getting started.
The example below assumes a public page with a product title and price in elements matching h1.product-title and .product-price. Replace the URL and selectors with ones that match the page you are permitted to access.
#1 Best Overall
- Includes Raspberry Pi 5 with 2.4Ghz 64-bit quad-core CPU (8GB RAM)
- Includes 128GB Micro SD Card pre-loaded with 64-bit Raspberry Pi OS, USB MicroSD Card Reader
- CanaKit Turbine Black Case for the Raspberry Pi 5
- CanaKit Low Noise Bearing System Fan
- Mega Heat Sink - Black Anodized
Open the page, wait for the data, and extract it
Save this as scrape.mjs in a project where Puppeteer is installed, then run it with node scrape.mjs.
import puppeteer from 'puppeteer';
const url = 'https://example.com/public-product';
const browser = await puppeteer.launch({ headless: true });
try {
const page = await browser.newPage();
await page.goto(url, { waitUntil: 'domcontentloaded', timeout: 30000 });
// Wait for the specific content this task needs.
await page.waitForSelector('h1.product-title', { timeout: 10000 });
await page.waitForSelector('.product-price', { timeout: 10000 });
// Run in the page context and return only the required fields.
const result = await page.evaluate(() => {
const title = document.querySelector('h1.product-title')?.textContent?.trim() ?? null;
const price = document.querySelector('.product-price')?.textContent?.trim() ?? null;
return { title, price };
});
if (!result.title || !result.price) {
throw new Error(`Required field missing: ${JSON.stringify(result)}`);
}
console.log(JSON.stringify({ url, ...result }, null, 2));
} finally {
await browser.close();
}page.evaluate executes the supplied function in the page’s context and returns its result; Puppeteer waits for a returned promise to resolve. See the Page.evaluate API. Keep browser-side work self-contained: the function runs in the page, not in your Node.js module scope.
Rank #2
- Includes Raspberry Pi 5 16GB with 2.4Ghz 64-bit quad-core CPU (16GB RAM)
- Includes 128GB Micro SD Card pre-loaded with 64-bit Raspberry Pi OS, USB MicroSD Card Reader
- CanaKit Turbine Black Case for the Raspberry Pi 5
- CanaKit Low Noise Bearing System Fan
- Mega Heat Sink - Black Anodized
Choose selectors that match the page
Puppeteer selectors support CSS and additional syntax for text, accessibility attributes, XPath, and querying across open shadow roots. Prefer a selector tied to a stable element or accessible label, and check that it identifies the intended element on the target page. Puppeteer recommends locators for selecting and interacting with elements because they wait for relevant element and action conditions. Page interactions and locators and waitForSelector API document these options.
Windows Errors? Fix Them Before They Spread
Repair common Windows errors and clear accumulated junk for a smoother, more stable PC - no reinstall needed.Free scan · no reinstallOutdated Drivers Are Slowing You Down
One free scan finds every outdated or missing driver and matches the right update for your exact hardware.Free scan · exact hardware matchFor example, if the data appears under a unique accessible label, a locator may be more robust than a deeply nested CSS path. If you use waitForSelector, it waits for the selector to appear, can return immediately if it is already present, and accepts a configurable timeout. A selector that appears before its text is populated may still require a further check for the required value.
Rank #3
- CanaKit Raspberry Pi 5 Essentials Starter Kit
Wait for content, not just for the browser to become quiet
For data that renders asynchronously, wait for a content-specific selector or another explicit condition. Network idleness is another available signal: waitForNetworkIdle waits for network activity to remain idle for the configured period. Its documented default idle time is 500 milliseconds in the referenced API version, but that is not a promise that all page content is ready. Analytics, streaming requests, or delayed rendering can make network activity a poor proxy for the field you need. Pair a general network wait with a check for the actual data when appropriate. See waitForNetworkIdle API.
- Use a selector wait when a particular element marks readiness.
- Use a network-idle wait only when network quiet is meaningful for the page and task.
- Set timeouts intentionally; a longer timeout gives slow pages more time but delays reporting a failure.
Inspect the output and handle failures carefully
Check that each required value exists and has the expected shape before storing or using it. A missing field can mean the selector changed, the page did not finish rendering, or the page returned a different state than expected. Log the page URL and the specific failure, but avoid keeping more page data than necessary.
Rank #4
- All-in-One Complete Kit: This SANOOV RPi 5 bundle comes with Raspberry Pi 5 4GB RAM single board, active cooler, durable ABS case and screwdriver. No extra parts needed, ready to use right out of the box for beginners and hobbyists
- Powerful Single Board Computer: Equipped with 4GB RAM and high-performance processor, delivers fast running speed for 4K playback, AI projects, programming and daily computing tasks. SANOOV for raspberry pi 5 4GB is equipped with broadcom 64 quad-core Arm Cortex A76 processor with gigabit ethernet and upgraded with IEEE 802.11ac Wi-Fi, Bluetooth 5.0 dual-band 2.4Ghz and 5Ghz and Power Over Ethernet (POE). Upgrading delivers 2-3 x speed vs Pi 4, redefining the experience
- Efficient Active Cooler: Effectively lowers operating temperature and prevents performance throttling. Runs quietly even under long-time heavy load, ensures stable operation all day long. SANOOV RPi 5 4GB kit offer an active cooler, which combines an aluminium heatsink with a high-performance PWM fan. Active cooler is fully compatible with the Pi OS, which can effectively reduce the temperature of RPi5 and ensure its good performance during long-term high load operation
- Sturdy ABS Protective Case: Well-fitted for Raspberry Pi 5 board, can be secured with 4 screws to effectively protect the Pi 5 motherboard from damage, reserves full access to all ports and buttons. SANOOV uses ABS material to produce the case, which has a softer texture and feel. Meanwhile, SANOOV case adopts a layered design for easy disassembly and installation. (Tip: The Case cannot install M.2 HAT Add on Board and Solid State Drive!)
- Wide Application & Full Compatibility: Seamlessly compatible with official OS and mainstream peripheral accessories for Raspberry Pi 5. Whether you are a beginner, student, electronics hobbyist or professional developer, this all-in-one kit meets your diverse needs. It excels in IoT projects, robotics design, retro gaming devices, home media servers and other DIY creations. Backed by a large global community, you can easily find guides, technical support and shared projects online
Retry only when a transient failure is plausible, and use a limited retry policy rather than repeatedly reloading a page that is consistently unavailable or denying access. Always close the browser in a finally block so failures do not leave browser processes running.
Quick wins for a faster PC:
Repair Windows errors before they cause bigger problemsFix Now →Fix the driver behind crashes, sound loss and screen glitchesFind Drivers →Clear out junk files and repair common Windows errorsFree Scan →Respect access boundaries before collecting data
RFC 9309 describes robots.txt as a protocol for communicating crawler access rules and states, “These rules are not a form of access authorization.” Read the IETF RFC 9309, Robots Exclusion Protocol alongside the target site’s terms and requirements that apply to your use. An accessible page or a robots.txt response does not settle questions about permission, privacy, copyright, database rights, or local law. If the site blocks the request or requires authentication, do not work around that restriction. A robots.txt fetch failure is not permission to proceed.
Best Value
- 【What you Get】You will get 1*Pi 5 8GB Single Board,1*RasTech Case,1*Active Cooler,1*Screwdriver,1*Installation instructions,12-month free warranty, lifetime service, 24-hour prompt and friendly response.
- 【More Connectors】There are two USB 3.0 ports(5Gbps simultaneously) and two USB 2.0 ports, which triple total bandwidth ,support any combination of up to two cameras or displays. Peak SD card performance is doubled through support for the SDR104 high-speed mode. It provides a smooth desktop experience for you. Offer Gigabit Ethernet and a PCIe interface, along with dual-band Wi-Fi and Bluetooth 5.0/BLE wireless capability. The RasTech Pi 5 Kit use the new 27W 5.1V 5A USB-C power connector.
- 【 Support Dual 4Kp60 Display 】Each of the two microHDMI sockets can control a 4K display at 60 Hertz, now support HDR, offering super HD video for media streaming projects. RPi 5 is the first RPi model that comes with a PCI Express port (PCIe 2.0 x1 with 500 MB/s) to attach SSDs (requires separate M.2 HAT).
- 【 Excellent Chips And Applications】Pi 5 is a full-size Pi computer using silicon built in-house at Pi. The RP1 “southbridge” provides the bulk of the I/O capabilities for Pi 5. Pi 5 is more friendly and convenient in the development of Internet of Things, Web development, machine identification, automatic control and other electronic equipment applications and network.
- 【 Faster CPU, Better GPU 】 Pi 5 features a Broadcom BCM2712 64-bit quad-core Arm Cortex-A76 processor running at 2.4GHz, it delivers a 2–3× increase in CPU performance relative to RaspberryPi 4. The 800MHz VideoCore VII GPU is compatible to OpenGL ES 3.1 and Vulkan 1.2, substantial uplift in graphics performance. Pi 5 Offers lightning-fast CPU speed, a PCI Express interface, a Real Time Clock (RTC) and a power button and runs significantly cooler than Pi 4.
Or skip the browser setup
If your task is to capture a page as an image or PDF rather than extract structured fields, ScreenshotNeo offers a one-request screenshot API. It is not a replacement for Puppeteer when you need custom extraction logic.
For example, this cURL request saves a screenshot of the target page as WebP:
curl -G "https://api.screenshotneo.com/v1/shot" -d access_key=YOUR_API_KEY --data-urlencode url=https://example.com/public-product -o shot.webpSee the ScreenshotNeo API documentation for request options. Cookie banners, popups, and chat widgets are removed before capture; bot checks, blank pages, and failed loads are not billed. Its MCP server lets AI agents take screenshots, and the free plan includes 1,000 screenshots a month with no card; paid plans start at $5 for 3,000. Sign up for 1,000 free screenshots a month with no card.
What’s actually slowing this PC down?
Pick the symptom - the matching free tool is one click away.
Frequently Asked Questions
Does Puppeteer scrape data from a page that is not rendered in the browser?
This workflow reads content available in the browser page. If the needed value is not present in the rendered page, this example will not retrieve it.
Does robots.txt give permission to scrape a page?
No. RFC 9309 says robots.txt rules are not a form of access authorization; review the site’s terms and applicable requirements separately.
Quick Recap
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
