Halloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsSlow PC?RecommendedPC slow today? Run a repair scan before it gets worseResolve common Windows issues and optimize system performance.Scan NowHalloween DealsAmazon USOctober picks are moving - compare before checkoutAmazon US: current deals, useful picks and tech finds.See Picks×
FREEDOM251

Freedom251 › Blog › Chrome automation

Take Screenshots of Indian Job Listing Pages in Bulk with Go chromedp

By Freedom251 Team · · 7 min read

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Use Go’s chromedp to automate Chrome or Chromium, capture each supplied job-listing URL, and save the resulting image. The reliable pattern is one page at a time: navigate, wait for a page-specific condition, capture the viewport or full page, write the bytes, and record failures without losing the rest of the batch. chromedp drives a browser through Chrome DevTools Protocol; it does not include the browser.

What you need before capturing pages

  • A Go installation and a Go module for your program.
  • A compatible Chrome or Chromium binary in the execution environment, or access to an existing DevTools endpoint. chromedp can launch a browser or connect to a remote endpoint, but does not bundle one.
  • An explicit list of listing-page URLs. This example processes only the URLs provided; it does not discover or crawl additional listings.
  • A readiness condition and capture scope suited to each target page. Job portals may render content differently or require authentication; no particular Indian portal or access behavior is assumed here.

Check the current rules and requirements for each site before automating it. The available technical documentation does not establish the access terms, login behavior, or robots rules of any specific job portal.

As an Amazon Associate I earn from qualifying purchases.

Set up a Go project

Create a directory and initialize a module, then add chromedp:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
mkdir job-shots
cd job-shots
go mod init example.com/job-shots
go get github.com/chromedp/chromedp

Make sure Chrome or Chromium is installed and available to the process. For reproducibility, record the Go module version and browser version used in your environment; check the API signatures against the chromedp version pinned in your project.

#1 Best Overall
Philips 24 Inch Computer Monitor FHD 100Hz VA VESA Flicker-Free, 241V8LB | 1920×1080 LED Monitor, 4ms GtG, Adaptive Sync, HDMI 1.4, Tilt Adjust, Low Blue Light, 4yr Advance Replacement Warranty
  • CRISP CLARITY: This 23.8″ Philips V line monitor delivers crisp Full HD 1920x1080 visuals. Enjoy movies, shows and videos with remarkable detail
  • INCREDIBLE CONTRAST: The VA panel produces brighter whites and deeper blacks. You get true-to-life images and more gradients with 16.7 million colors
  • THE PERFECT VIEW: The 178/178 degree extra wide viewing angle prevents the shifting of colors when viewed from an offset angle, so you always get consistent colors
  • WORK SEAMLESSLY: This sleek monitor is virtually bezel-free on three sides, so the screen looks even bigger for the viewer. This minimalistic design also allows for seamless multi-monitor setups that enhance your workflow and boost productivity
  • A BETTER READING EXPERIENCE: For busy office workers, EasyRead mode provides a more paper-like experience for when viewing lengthy documents

Bulk capture with Go chromedp

This runnable starter processes URLs sequentially, waits for a visible selector, captures the full page as PNG, and continues after individual failures. Supply the URLs as command-line arguments. Change the readiness selector to one verified on each target portal; a selector that is not present will cause that page to time out.

package main

import (
	"context"
	"fmt"
	"log"
	"os"
	"path/filepath"
	"strings"
	"time"

	"github.com/chromedp/chromedp"
)

func main() {
	if len(os.Args) < 2 {
		log.Fatal("usage: go run . URL [URL ...]")
	}

	if err := os.MkdirAll("shots", 0o755); err != nil {
		log.Fatalf("create output directory: %v", err)
	}

	// The allocator launches Chrome/Chromium using the environment's
	// available browser configuration. Set up a remote allocator instead
	// if connecting to an existing DevTools endpoint.
	allocCtx, cancelAllocator := chromedp.NewExecAllocator(context.Background(), chromedp.DefaultExecAllocatorOptions[:]...)
	defer cancelAllocator()

	browserCtx, cancelBrowser := chromedp.NewContext(allocCtx)
	defer cancelBrowser()

	failed := 0
	for i, rawURL := range os.Args[1:] {
		url := strings.TrimSpace(rawURL)
		if url == "" {
			log.Printf("skip argument %d: empty URL", i+1)
			failed++
			continue
		}

		ctx, cancel := context.WithTimeout(browserCtx, 45*time.Second)
		var png []byte
		err := chromedp.Run(ctx,
			chromedp.Navigate(url),
			// Replace this with a visible, meaningful selector for the site.
			chromedp.WaitVisible("body", chromedp.ByQuery),
			chromedp.FullScreenshot(&png, 100),
		)
		cancel()

		if err != nil {
			log.Printf("capture failed for %q: %v", url, err)
			failed++
			continue
		}

		name := fmt.Sprintf("%03d.png", i+1)
		path := filepath.Join("shots", name)
		if err := os.WriteFile(path, png, 0o644); err != nil {
			log.Printf("write %q for %q: %v", path, url, err)
			failed++
			continue
		}
		log.Printf("saved %s from %s", path, url)
	}

	if failed > 0 {
		log.Printf("finished with %d failed or skipped page(s)", failed)
		os.Exit(1)
	}
}

Run it with one or more listing URLs:

go run . 'https://example.com/jobs/role-a' 'https://example.org/careers/role-b'

The example uses body as a generic wait so the starter can run on ordinary documents. For useful job-page captures, replace it with a selector that signals the relevant listing content is visible—for example, a listing container or page heading confirmed in that site’s rendered DOM. A visible body alone does not prove that dynamic results have finished loading.

Failure policy and output identity

The loop gives each URL its own 45-second context deadline. A failed navigation, wait, or capture is logged with its URL; later URLs still run. Files use their input position for stable names, so the same input order produces the same names. For recurring or audit-sensitive batches, also write a manifest mapping each filename to its original URL and capture outcome.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #2
Philips 22 Inch Computer Monitor FHD 100Hz VA VESA Flicker-Free, 221V8LB | 1920×1080 LED Monitor, 4ms GtG, Adaptive Sync, HDMI 1.4, Tilt Adjust, Low Blue Light, 4yr Advance Replacement Warranty
  • CRISP CLARITY: This 22 inch class (21.5″ viewable) Philips V line monitor delivers crisp Full HD 1920x1080 visuals. Enjoy movies, shows and videos with remarkable detail
  • 100HZ FAST REFRESH RATE: 100Hz brings your favorite movies and video games to life. Stream, binge, and play effortlessly
  • SMOOTH ACTION WITH ADAPTIVE-SYNC: Adaptive-Sync technology ensures fluid action sequences and rapid response time. Every frame will be rendered smoothly with crystal clarity and without stutter
  • INCREDIBLE CONTRAST: The VA panel produces brighter whites and deeper blacks. You get true-to-life images and more gradients with 16.7 million colors
  • THE PERFECT VIEW: The 178/178 degree extra wide viewing angle prevents the shifting of colors when viewed from an offset angle, so you always get consistent colors

Choose the screenshot scope and format

chromedp offers different capture actions; choose based on what the image needs to show rather than treating them as interchangeable.

Capture action What it captures Use it when
chromedp.CaptureScreenshot The current viewport. You need the visible browser window rather than content below the fold.
chromedp.Screenshot A selected DOM element. You need a particular listing card, results region, or other node.
chromedp.ScreenshotScale A selected element at a specified scale. You need to control the scale of an element capture.
chromedp.FullScreenshot The page beyond the viewport. You need a full-page image; the documented example notes that this overrides device-emulation settings.

The documented screenshot behavior uses JPEG when the quality value is below 100 and PNG at quality 100. Confirm the exact behavior and available signatures for the version you pin. The sample uses full-page PNG. For a viewport capture, replace the full-page action with chromedp.CaptureScreenshot(&png); for element capture, use the selector-based screenshot action and handle the target element’s selector explicitly.

Make readiness checks match each portal

Fixed sleeps are easy to write but can be too short on slow pages and waste time on fast ones. Prefer waits tied to meaningful page state or a selector that indicates the listing content is ready. The appropriate condition depends on the target site’s markup and dynamic loading behavior.

Rank #3
Dell 24 Monitor - SE2426H - 23.8-inch FHD (1920x1080) 144Hz 1ms Display, in-Plane Switching (IPS) Technology, AMD FreeSync™, TÜV 3-Star 2X HDMI, Tilt
  • Clear visuals. Fluid motion: A 144Hz refresh rate and 1ms MPRT deliver smooth, tear‑free motion across work, gaming, and streaming for clearer, more fluid viewing.
  • Eye comfort: TÜV Rheinland 3‑star* certification reduces harmful blue light while preserving stunning color quality without compromise. *TÜV Rheinland 3-star eye comfort certification.
  • Wide viewing angle: Get consistent views across a wide 178° /178° viewing angle.
  • In-Plane Switching (IPS): See excellent color accuracy and consistency across wide viewing angles with In-plane Switching (IPS) technology.
  • Ultra-thin bezels: Maximize your viewing experience with thin bezels.
  • Inspect a representative page and choose a selector that appears only when the intended listing region is available.
  • Check whether the page needs authentication, user-driven state, or a particular viewport before capture.
  • Set a deadline per page so a slow or stalled URL does not hold up the remaining batch indefinitely.
  • Validate the saved images on representative pages and browser versions; selector visibility does not guarantee every image or asynchronously loaded field is complete.

Batch size, performance, and reliability

Start with sequential processing, as in the sample. It keeps the browser workflow simple and avoids creating unnecessary load on third-party portals. If measured throughput requires concurrency, add a bounded worker pool rather than launching an unbounded browser task for every URL. Concurrent targets consume resources, and no performance benchmark or safe concurrency limit has been established for this specific use case.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

For larger runs, retain per-page timeouts and log the URL, output path, and error. Consider retrying only failures that appear transient, and keep retries bounded so a persistent block or broken page does not generate repeated requests. Keep the original URL list so failed entries can be reviewed or rerun deliberately.

Troubleshooting common failures

Chrome or Chromium does not start

chromedp needs a compatible browser binary when launching locally. Install Chrome or Chromium in the runtime and verify that the process can access it; alternatively configure a connection to an existing DevTools endpoint.

Rank #4
Sale
Samsung 27" Essential S3 (S36GD) Series FHD 1800R Curved Computer Monitor | 100Hz, Game Mode, Advanced Eye Comfort, HDMI and D-sub Ports (LS27D366GANXZA)
  • CURVED FOR ENHANCED ENGAGEMENT: An immersive viewing experience with a curved monitor that wraps more closely around your field of vision; It creates a wider view, enhancing depth perception and minimizing peripheral distraction
  • SMOOTH PERFORMANCE FOR SEAMLESS CONTENT: Stay in the action when playing games, watching videos, or working on creative projects; The 100Hz refresh rate reduces lag and motion blur so you don't miss a thing in fast-paced moments¹
  • MORE GAMING POWER: Gain the edge with optimizable game settings; Color and image contrast can be adjusted to see scenes more vividly and spot enemies hiding in the dark; Game Mode adjusts any game to fill the screen so you can view every detail²
  • KEEP IT EASY ON THE EYES: Care for your eyes and stay comfortable, even during long sessions; Advanced eye comfort technology certified by TÜV reduces eye strain by minimizing blue light and reducing irritating screen flicker²
  • INCREASED VERSATILITY: Connect to more; Plug devices straight into your monitor for increased flexibility, making your computing environment even more convenient

The page times out waiting for a selector

The selector may not exist on that portal, may differ by page state, or may appear only after authentication or another interaction. Inspect the rendered page, choose a site-appropriate readiness condition, and check the target page’s requirements. Do not assume a selector from one job site works on another.

The screenshot is blank or misses listings

A successful navigation is not necessarily proof that the listings have rendered. Wait for a meaningful visible listing element rather than only the document body, and verify the saved output on that page. Dynamic content and user-driven state may require portal-specific handling.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

One bad URL stops the whole batch

Ensure the per-page error path logs the failing URL and continues the loop, as in the sample. If the batch should instead be all-or-nothing, collect results first and apply that policy after processing; the starter intentionally preserves successful captures when another URL fails.

Best Value
Sale
Sceptre New 22-Inch Gaming Monitor, FHD 1080p, Up to 144Hz, HDMI, DisplayPort, Built-in Speakers, Machine Black (E225W-FW144 Series, 2026)
  • 【INTEGRATED SPEAKERS】Whether you're at work or in the midst of an intense gaming session, our built-in speakers provide rich and seamless audio, all while keeping your desk clutter-free.
  • 【EASY ON THE EYES】 Protect your eyes and enhance your comfort with Blue-Light Shift technology. This feature reduces harmful blue light emissions from your screen, helping to alleviate eye strain during long hours of use and promoting healthier viewing habits.
  • 【WIDEN YOUR PERSPECTIVE】Our sleek minimal bezel design ensures undivided attention. The nearly bezel-free display seamlessly connects in a dual monitor arrangement, delivering an unobstructed view that lets you focus on more at once, completely distraction-free.

Capture dimensions or output differ from expectation

Confirm whether you chose viewport, element, or full-page capture and check the behavior against your pinned chromedp version. In particular, the documented FullScreenshot behavior overrides device-emulation settings, and screenshot quality affects PNG versus JPEG output.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Or skip the browser setup

ScreenshotNeo offers a website screenshot API and MCP server. A single GET request can return an image or PDF; the API also supports bulk capture of up to 100 URLs per call. For one URL, the cURL example is:

curl -G "https://api.screenshotneo.com/v1/shot" -d access_key=YOUR_API_KEY --data-urlencode url=https://example.com/jobs/role-a -o shot.webp

See the ScreenshotNeo API documentation for authentication and options. Its cookie-banner, newsletter-popup, and chat-widget removal runs before capture and can be turned off; bot checks, blank pages, timeouts, failed loads, and cache hits are not billed. Its MCP server provides take_screenshot, get_page_info, and capture_pdf for AI agents. The Free plan includes 1,000 shots per month with no card; paid plans start at $5 for 3,000 shots. Sign up for the free plan to try it.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Frequently asked questions

Does this program find Indian job listings automatically?

No. It captures only the URLs you pass to it; it does not search portals or discover additional listing pages.

Can I use the same readiness selector on every job portal?

Only if the target pages share that rendered element and it reliably indicates readiness. Verify the selector for each portal and relevant page state.

Can I capture a listing card instead of the whole page?

Yes. Use chromedp’s selector-based element screenshot action with a selector for the card or results region, and confirm the selected element exists before capture.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Chrome automationchromedpGojob listingswebsite screenshots

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Recommended PC Tool
Recommended PC Tool
Windows Errors? Fix Them Before They SpreadFree repair scan
Crashes, No Sound, or Screen Glitches?Free driver scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.