Driver FixRecommendedSound, Wi-Fi or graphics acting up? Check drivers firstFind missing or outdated drivers fast.Check DriversHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsSlow PC?RecommendedPC slow today? Run a repair scan before it gets worseResolve common Windows issues and optimize system performance.Scan Now×
FREEDOM251

Freedom251 › Blog › browser automation

How to Capture Screenshots of Long Pages in Bulk Without Blank Sections

By Freedom251 Team · · 6 min read

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

To capture long pages in bulk without blank sections, automate a real browser: set a consistent viewport, load each URL, trigger content that appears on scroll or interaction, wait for a page-specific readiness condition, and then take a full-page screenshot. In Playwright, use page.screenshot({ path: 'screenshot.png', fullPage: true }). That option captures the full scrollable page; it does not make every lazy-loaded or interaction-triggered section appear automatically.

Why full-page screenshots can still contain blank sections

A full-page screenshot captures the document beyond the visible viewport as one tall image. It controls how much of the page is captured, not whether the content has finished rendering. A section may be blank because the page has not yet loaded it, because it appears only after scrolling or another interaction, or because the layout is still changing. Treat an empty area first as a page-state problem to investigate, rather than assuming the screenshot flag failed.

As an Amazon Associate I earn from qualifying purchases.

There is no universal wait condition that guarantees every site’s lazy loading, infinite scrolling, or custom rendering has completed. A reliable workflow therefore prepares each page and checks the state that matters for that page.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Build a repeatable bulk-capture workflow

  1. Choose the capture environment. Playwright provides browser automation and screenshot controls; Puppeteer is another option, especially for JavaScript workflows. Use a hosted service only after checking its privacy, authentication, operational, and cost requirements.
  2. Set the viewport before navigating. Choose the width and height you want consistently across the batch. Viewport changes can alter responsive layouts, so use the same intended dimensions for comparable captures.
  3. Navigate and prepare the page. Handle predictable overlays in the normal flow. If an unpredictable dialog can block the page, configure an appropriate handler. Scroll or interact with the page when content is triggered by those actions.
  4. Wait for a meaningful page condition. Prefer a known element or state that signals the required content is ready. A fixed delay can help with a known site, but elapsed time alone does not prove that all visual sections have rendered.
  5. Capture the full document. Use Playwright’s fullPage: true for the whole scrollable page. Use an element screenshot instead when only a defined component is needed.
  6. Validate representative results before scaling. Inspect sample images for missing sections, overlays, and unstable layout. Adjust page preparation or readiness checks for pages that are incomplete, and retain failures for review rather than silently treating them as successful captures.

Runnable Playwright example for a URL list

This Node.js example sets one viewport, visits each URL, waits for a site-specific selector, captures the full page, and records per-URL failures while continuing through the list. Replace the example URLs and readiness selector with values appropriate to the pages being captured. Install Playwright and its browser before running it.

#1 Best Overall
Sale
Epson Workforce ES-50 Compact & Lightweight Mobile Document Scanner | For Computers including PC and Mac Receipt and Document Scanner USB Powered
  • PORTABLE SCANNER FOR USE ON-THE-GO — The fastest and lightest mobile single-sheet-fed compact document scanner in its class¹
  • QUICK DOCUMENT SCANNING ― This Epson ultra-fast scanner scans a single page as quickly as 5.5 seconds²; Windows and Mac compatible
  • VERSATILE PAPER HANDLING ― Portable scanner scans documents up to 8.5 x 72 in; Also easily digitizes receipts and ID cards to make accounting, bookkeeping, and organizing simpler
  • INTUITIVE, HIGH-SPEED SOFTWARE — Epson ScanSmart Software³ is a smart tool allowing you to easily scan, review, and save; Stay organized easily with the help of this Epson scanner
  • EASY SETUP — USB-powered connect to your computer for quick and simple scanning; No batteries or external power supply required to operate portable document scanner; Standard Connectivity: USB 2.0
const { chromium } = require('playwright');
const fs = require('node:fs/promises');

const urls = [
  'https://example.com/page-one',
  'https://example.com/page-two',
];

(async () => {
  const browser = await chromium.launch();
  const page = await browser.newPage({ viewport: { width: 1440, height: 900 } });
  await fs.mkdir('screenshots', { recursive: true });

  const failures = [];
  try {
    for (const [index, url] of urls.entries()) {
      const output = `screenshots/page-${String(index + 1).padStart(3, '0')}.png`;
      try {
        await page.goto(url, { waitUntil: 'domcontentloaded', timeout: 60000 });
        // Replace this with a selector that means the needed content is ready.
        await page.locator('main').waitFor({ state: 'visible', timeout: 30000 });
        await page.screenshot({ path: output, fullPage: true });
        process.stdout.write(`Saved ${url} to ${output}n`);
      } catch (error) {
        failures.push({ url, error: String(error) });
        process.stderr.write(`Failed ${url}: ${error.message}n`);
      }
    }
  } finally {
    await browser.close();
  }

  if (failures.length) {
    await fs.writeFile('screenshots-failures.json', JSON.stringify(failures, null, 2));
    process.exitCode = 1;
  }
})();

The selector main is only an example: a visible main container may not mean that images, lazy sections, or page-specific widgets are ready. Choose a condition tied to the content you need. For scroll-triggered content, scroll through the relevant regions before the final capture and wait for those sections to appear. Infinite-scroll pages may require a defined stopping rule, such as reaching an expected item or the end of a known set; a full-page flag alone does not exhaust an unbounded feed.

Choose the right screenshot scope

Use full-page capture when the entire long document is the deliverable. Use an element screenshot when the desired result is one component, such as a report panel or article body; this narrows the capture target but does not remove the need to ensure that the element has rendered. Playwright also supports image buffers, clip regions, scale settings, and screenshot assertions when a workflow needs in-memory output, a defined region, resolution control, or visual checks.

Rank #2
Sale
Brother DS-640 Compact Mobile Document Scanner, (Model: DS640)
  • FAST SPEEDS - Scans color and black and white documents a blazing speed up to 16ppm (1). Color scanning won’t slow you down as the color scan speed is the same as the black and white scan speed.
  • ULTRA COMPACT – At less than 1 foot in length and only about 1. 5lbs in weight you can fit this device virtually anywhere (a bag, a purse, even a pocket).
  • READY WHENEVER YOU ARE – The DS-640 mobile scanner is powered via an included micro USB 3. 0 cable allowing you to use it even where there is no outlet available. Plug it into you PC or laptop and you are ready to scan.
  • WORKS YOUR WAY – Use the Brother free iPrint&Scan desktop app for scanning to multiple “Scan-to” destinations like PC, Network, cloud services, Email and OCR. (2) Supports Windows, Mac and Linux and TWAIN/WIA for PC/ICA for Mac/SANE drivers. (3)
  • OPTIMIZE IMAGES AND TEXT – Automatic color detection/adjustment, image rotation (PC only), bleed through prevention/background removal, text enhancement, color drop to enhance scans. Software suite includes document management and OCR software. (4)

Other ways to automate capture

Option What the documentation establishes When to consider it
ScreenshotNeo Website screenshot API and MCP server; a GET request can return an image or PDF. It removes supported consent banners, newsletter popups, and chat widgets before capture, and bills only clean shots. Try first if you want hosted capture, clean shots, and explicit page-verdict and billing headers.
Playwright Browser automation with full-page and element screenshots, among other capture controls. Use when you need to control navigation, interaction, readiness checks, and batch logic in your own automation.
Puppeteer Chrome for Developers describes it as a JavaScript library for browser automation over Chrome DevTools Protocol and WebDriver BiDi, including full-page or element screenshots. Consider it when it fits your existing JavaScript and browser automation setup.
ScreenshotCenter Its documentation describes step-based browser interaction and full-page screenshots. Evaluate it as hosted automation if its terms and operational fit meet your needs; pricing and partner terms are not established here.

These are capability descriptions, not a reliability benchmark. Compare options by interaction control, page-specific waiting and validation, viewport versus full-page or element output, bulk orchestration and failure review, output format and resolution, and whether processing is local or hosted.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Or skip the browser setup

ScreenshotNeo takes a URL in one GET request and returns a screenshot or PDF. Before the shot, it accepts the cookie or consent banner as a visitor and removes more than 60 known consent platforms, newsletter popups, and chat widgets; each step can be turned off. Bot checks and CAPTCHAs, blank pages, timeouts, failed loads, and cache hits are not billed, and response headers identify the page verdict and billing status. Its MCP server provides take_screenshot, get_page_info, and capture_pdf tools for AI agents and MCP clients. The free plan includes 1,000 shots per month with no card; paid plans start at $5 for 3,000 shots.

Example cURL request (see the ScreenshotNeo API documentation):

Rank #3
Sale
Canon imageFORMULA R10 - Portable Document Scanner, USB Powered, Duplex Scanning, Document Feeder, Easy Setup, Convenient, Perfect for Mobile Users, White
  • STAY ORGANIZED – Easily convert your paper documents into digital formats like searchable PDF files, JPEGs, and more.Power Consumption : 2.5W or less (Energy Saving Mode: 0.7W). Suggested Daily Volume : 500 scans..Does it contain liquid: no
  • CONVENIENT AND PORTABLE –lightweight and small in size, you can take the scanner anywhere from home offices, classrooms, remote offices, and anywhere in between
  • HANDLES VARIOUS MEDIA TYPES – Digitize receipts, business cards, plastic or embossed cards, reports, legal documents, and more
  • FAST AND EFFICIENT – No technical hurdles or complicated setups here; easily scan both sides of a document at the same time, in color or black-and-white, at up to 12 pages-per-minute, and with a 20 sheet automatic feeder
  • BROAD COMPATIBILITY – Works with both Windows and Mac devices, be it laptop or computer
curl -G "https://api.screenshotneo.com/v1/shot" -d access_key=YOUR_API_KEY --data-urlencode url=https://stripe.com -o shot.webp

Sign up for ScreenshotNeo’s free plan: 1,000 screenshots a month, no card required.

Troubleshoot missing or unreliable sections

  • A section is blank in the image. Check whether it appears after scrolling or interaction in a normal browser session. Reproduce that action in the automation, then wait for the section’s own selector or ready state.
  • The page looks incomplete despite a successful navigation. Navigation completion and visual readiness are different. Wait for the content your capture needs rather than relying only on a generic page-load event or fixed pause.
  • An overlay hides the content. Handle a predictable overlay explicitly; for unpredictable dialogs, use an appropriate browser handler. Recheck the page after dismissal before capturing.
  • Captures differ between runs. Keep viewport settings consistent and identify content that changes after navigation. Use page-specific readiness checks and inspect representative outputs before running the entire list.
  • One URL fails in a batch. Record the URL and error, continue or stop according to the workflow’s needs, and review failures separately. Do not silently count an unsuccessful capture as a valid output.
  • A page keeps growing while scrolling. Infinite-scroll behavior needs a stopping condition for the task. Define the expected content boundary or number of items; full-page capture does not determine when an unbounded page is complete.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Performance, reliability, and cost considerations

Bulk capture is a repeated browser workflow, so its practical speed and reliability depend on each page’s load behavior, interactions, and readiness conditions. There is no cross-tool benchmark establishing a universal fastest or most reliable choice. Validate a small, representative set before increasing batch size, keep failures visible, and avoid using a delay as a substitute for confirming the actual content.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #4
IRIScan Express 4 Black Compact Portable USB Simplex Document Scanner, 8 PPM for Contracts, Invoices and Business Cards, Compatible with Windows, Readiris PDF Included
  • IRIScan Express, portable scanner : scans color and black and white documents a blazing speed up to 8ppm simplex. Color scanning won’t slow you down as the color scan speed is the same as the black and white scan speed.
  • IRIScan Express mobile scanner is powered via an included micro USB 2. 0 cable allowing you to use it even where there is no outlet available. Plug it into you PC or laptop and you are ready to scan. USB cable provided. AC Adapter not provided and not needed.
  • IRIScan flatbed scanner uses a simplex scanning mode allows for quick and straightforward scanning of single-sided documents. IRIScan with its full portable features is the ideal document scanners for computers.
  • IRIScan document scanner : Versatile scanning capabilities, including scanning to Word, PDF, and Excel formats with companion software provided Readiris OCR
  • Receipt scanner and card scanner with Additional features include scanning business cards directly to Outlook, photo scanning, and receipt scanning for efficient document management

Local automation gives you direct control of browser behavior and output handling, while hosted capture shifts browser execution to a service and makes privacy, authentication, terms, and pricing important selection criteria. ScreenshotNeo’s plans include 1,000 free monthly shots with no card, then $5 for 3,000 on Starter; higher tiers are Growth $15 for 15,000, Pro $39 for 60,000, Scale $99 for 250,000, and Business $249 for 1,000,000. Yearly billing gives two months free, and every feature is available on every plan. Confirm that hosted processing suits the data in your URLs before sending authenticated or sensitive pages to a provider.

Quick Recap

SaleBestseller No. 3
Canon imageFORMULA R10 - Portable Document Scanner, USB Powered, Duplex Scanning, Document Feeder, Easy Setup, Convenient, Perfect for Mobile Users, White
Canon imageFORMULA R10 - Portable Document Scanner, USB Powered, Duplex Scanning, Document Feeder, Easy Setup, Convenient, Perfect for Mobile Users, White
BROAD COMPATIBILITY – Works with both Windows and Mac devices, be it laptop or computer; This product is not intended for scanning photographs on photo paper / photographic media
$153.00
Bestseller No. 4
IRIScan Express 4 Black Compact Portable USB Simplex Document Scanner, 8 PPM for Contracts, Invoices and Business Cards, Compatible with Windows, Readiris PDF Included
IRIScan Express 4 Black Compact Portable USB Simplex Document Scanner, 8 PPM for Contracts, Invoices and Business Cards, Compatible with Windows, Readiris PDF Included
Find our Software here : irislink.com/start; IRIScan Express is only compatible Windows platform and not macintosh
$129.00
Bestseller No. 5
Canon Canoscan Lide 300 Scanner (PDF, AUTOSCAN, Copy, Send)
Canon Canoscan Lide 300 Scanner (PDF, AUTOSCAN, Copy, Send)
Scanner type: Document; Connectivity technology: USB; With Auto Scan Mode, the scanner automatically detects what you're scanning
$75.00
Best Value
Canon Canoscan Lide 300 Scanner (PDF, AUTOSCAN, Copy, Send)
  • Scanner type: Document
  • Connectivity technology: USB
  • With Auto Scan Mode, the scanner automatically detects what you're scanning
  • Digitize documents and images

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

browser automationPlaywrightPuppeteerscreenshot APIWeb development

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Recommended PC Tool
Recommended PC Tool
Crashes, No Sound, or Screen Glitches?Free driver scan
PC Slower Than It Used to Be?Free scan - under a minute

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.