DriversRecommendedOutdated drivers can make a good PC feel brokenScan driver issues before chasing fixes manually.Scan NowHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsClean PCRecommendedOne scan can reveal what keeps slowing WindowsLook for cleanup and repair opportunities.Run Scan×
FREEDOM251

Freedom251 › Blog › Developer Tools

How to Monitor Pages That Require Login with Urlwatch

By Freedom251 Team · · 6 min read

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

You can monitor a login-protected page with Urlwatch if you can retrieve its content using a valid session cookie, a suitable API request, a Browser job, or a custom job hook. Start with a normal URL job and cookies; use browser automation only when the content is not present in the server response. The right method depends on the site’s authentication and rendering, so test the retrieved output before trusting change alerts.

Choose the right way to retrieve the page

Urlwatch compares retrieved output with an earlier version and reports changes. Authentication is part of retrieving the page: notifications do not make a login-protected page accessible. The current Urlwatch 2.29 documentation describes URL and Browser jobs, but it does not establish one universal login procedure for every site (Urlwatch Jobs documentation).

As an Amazon Associate I earn from qualifying purchases.

  • Try a URL job with cookies first if the server returns the desired content when sent a valid session cookie.
  • Consider the page’s API if it requests the information from an endpoint that is appropriate for your use. Urlwatch’s documentation notes that monitoring API output can often be faster and lighter than running a browser.
  • Use a Browser job if the content you need appears only after JavaScript runs in a browser.
  • Consider a custom job or hook if the site’s login flow is not handled by those approaches and you can maintain site-specific code.

Use only access you are authorized to monitor, and check the site’s terms. Cookie, API, and browser approaches may not handle a site’s CSRF protections, OAuth, multifactor authentication, CAPTCHA, or rotating sessions without additional site-specific work.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Set up a URL job with a session cookie

A regular URL job can send cookies, along with HTTP methods and request data. The following example shows the configuration shape only; it has not been tested against a real site. Replace the URL, cookie name, and value with the details appropriate to your authorized session.

#1 Best Overall
Feit Electric Smart Wi-Fi Plug - Alexa and Google Home Compatible - 1 Count
  • WIFI ENABLED TO CONTROL FROM ANYWHERE – Transform your home into a smart home with the Feit Electric Smart Wi-Fi Plug. Remotely turn on or off lights, fans, coffee makers, or other home appliances from your smartphone or tablet. Works seamlessly with Alexa and Google Home, giving you effortless voice control without needing a separate hub. Manage your devices anytime, whether you’re at home, at work, or traveling.
  • SIMPLE SETUP, NO HUB REQUIRED – Enjoy the convenience of smart home automation without extra equipment. The plug connects directly to your 2.4 GHz Wi-Fi network, making installation fast and easy. Plug it in, download the Feit Electric app, follow the simple steps, and your devices are instantly connected. Perfect for beginners or anyone looking to expand their smart home ecosystem with minimal hassle.
  • SET YOUR ROUTINE & SAVE ENERGY – Save energy, stay organized, and automate daily routines with customizable schedules and timers. Set your lamps, heaters, or appliances to turn on and off automatically at specific times, ensuring your home is always comfortable and efficient. Ideal for morning routines, evening wind-downs, or holiday lighting, giving you peace of mind and energy savings without constant manual operation.
  • ENHANCED SAFETY & CONVENIENCE – Protect your home and appliances with the Feit Electric Smart Plug’s durable design and safety features. Its compact size fits easily into standard indoor outlets without blocking other sockets. With real-time app control and notifications, you can monitor appliance activity and prevent energy waste. Ideal for families, pet owners, or anyone seeking a smarter, safer, and more convenient home setup.
  • RELIABLE 2.4GHz WI-FI PERFORMANCE – Designed to work exclusively on 2.4 GHz networks, this smart plug provides stable connectivity for smooth operation of all your devices. Avoid interruptions caused by incompatible networks, ensuring your appliances respond instantly when controlled via the app or voice commands. Perfect for indoor home use, it supports up to 15 amps, handling heavy-duty appliances safely and reliably.
name: "Authenticated page"
url: "https://example.invalid/private-page"
cookies:
  SESSION_COOKIE_NAME: "<session-cookie-value>"
filter:
  - css: "main"

The filter is optional. It narrows the output to the part you want to monitor; choose a selector that matches the page you actually receive. Cookie names, accepted formats, expiry, and whether a cookie alone is sufficient are site-dependent.

Keep session values private

A session cookie can grant access as if you were logged in. Do not put real cookie values in a public repository, shared configuration, or article. Store configuration with the same care you would use for credentials, and refresh the cookie through an authorized login when it expires.

Verify the response before relying on alerts

Run the job and inspect what Urlwatch retrieves after applying the filter. Confirm that the output contains the authenticated content—not a login form, redirect notice, access-denied page, or expired-session message. Then check that a test diff reflects meaningful page changes rather than timestamps, rotating banners, or other routine noise. Urlwatch’s example configuration documents filters and a --test-filter workflow (Urlwatch example configuration).

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

When to use an API, Browser job, or custom hook

Monitor an API response when it is a suitable target

If the page gets its data from an API, inspect the browser’s network requests as a diagnostic to see whether a relevant endpoint exists. Use that endpoint only if the site’s interface, access rules, and stability make it appropriate. The endpoint may need its own authentication or request details; Urlwatch’s documentation does not define a universal way to satisfy those requirements.

Rank #2
Wintertion1U/Desktop/Rackmount Firewall Hardware,OPNsense, VPN, Network Security Appliance, Router PCN2600 D2700, 4 x Gigabit LAN, COM, VGA, Fan, 0 RAM, 0 Storage (Desktop Type, 4G RAM 64G SSD)
  • equipped with atom n2600 d2700 processor, compatible with many freebsd based router systems, linux distros, or win.os supported, easy configuration and management
  • Please note, this is a barebone only. A system memory, a storage drive and an operating system are needed to complete this system
  • 13-19 inches 1u, 50w power, with power cord, make sure to use a big brand memory and ssd/hdd with quality assurance
  • Designed with console, 2 x usb, 4 x lan, vga, power switch, size at 290 x 180 x 44mm
  • There are 2 inside reserved fans on chassis, which could be removed freely or be turned on in a high temperature environment to ensure the best function of the product

Use a Browser job for JavaScript-rendered content

Urlwatch’s Browser jobs use Playwright and are intended for pages where JavaScript must run to expose the content. The documented options include navigation, load waiting, selectors to wait for, and browser choice. Browser jobs require the optional Playwright package and installed browsers, and they consume substantially more resources than ordinary URL jobs. See the Urlwatch Jobs documentation for the current job configuration and setup details.

Choose waits and selectors that correspond to the element or state you need, rather than assuming that a page-load event means its data is ready. If a site changes its login or page behavior, recheck the captured output and revise the job.

Use a custom job only when you can maintain it

Urlwatch’s example configuration contains a commented-out custom-login illustration. It says the job kind is defined in hooks.py and must be enabled; it is not a turnkey built-in login system. The illustrated username and password parameters do not prove that Urlwatch can automatically handle a particular site’s CSRF tokens, multifactor prompts, CAPTCHA, or rotating sessions. Custom code adds ongoing maintenance when the site changes.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #3
Shelly Plus 1PM | WiFi Smart Relay Switch with Power Metering | Home Automation | Bluetooth Gateway | Compatible with Alexa & Google Home | No Hub | Wireless Lighting Control (2 Pack)
  • Shelly Plus 1 PM is a Wi-Fi smart relay switch with 1 channel, up to 16A with power metering that can be used also as a WiFi repeater and Bluetooth gateway. Shelly Plus 1PM can be used to monitor the consumption and take control of home appliances, electric circuits, and office equipment individually.
  • Automate electrical appliance and control - With Shelly Plus 1PM you can automate any electrical appliance in your home and control it remotely. Shelly Plus 1PM can control appliances with a large load which makes it perfect for kitchen appliances and domestic systems monitoring and control. You can get precise measurements of the power consumption of each appliance and switch in on/off remotely, no matter where you are.
  • Set and be prepared for everything - Reveal the full potential of Shelly Plus 1PM by combining it with other devices from your home network! Set Shelly Plus 1PM to activate custom scenes based on hour, light, or various occurrences. For example, you can set Shelly Door/Window sensor to report a porch door opening and activate Shelly Plus 1PM to turn on the hot tub heaters only in the hours after 8 pm.
  • Shelly Customer Service - Shelly is one of the fastest-growing Smart Home brands in the world with devices, providing solutions for the automation of private homes, buildings and businesses. We provide our customers with professional support and a 3 years device warranty.
  • Shelly Smart Control App will help you control your Shelly devices remotely and will send notifications for all automated events in your home. You can easily configure devices and manage their settings individually, or you can create personalized scenes by combining Shelly devices to trigger certain actions in your home automation.

Compare the available routes

Route Best fit Setup and tradeoff
URL job with cookies The server returns the needed content when sent a valid cookie. A simple URL job plus the site’s required cookie values. Session expiry or rotation can make it return a login page instead.
URL job against an API A permitted, suitable endpoint supplies the information you need. Identify the endpoint and provide any necessary request details. Access, authentication, and stability depend on the site.
Browser job JavaScript must run to reveal the content. Requires the optional Playwright package and installed browser; uses more resources and may need appropriate waits or selectors.
Custom hook or job The standard approaches do not cover the site’s login workflow, and you can maintain custom code. Requires implementation and upkeep. The official example is illustrative, not a general login feature.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Troubleshoot missed or misleading changes

  • Urlwatch shows a login page: the cookie may be missing, malformed, expired, or insufficient for the site’s session. Confirm the exact response and obtain a fresh session through the site’s authorized login process.
  • The page looks right in a browser but the URL job lacks the content: the content may be rendered by JavaScript. Check whether a suitable API provides it; otherwise configure a Browser job and verify its waits and selectors.
  • A Browser job fails to start: check that the optional Playwright package and required browser installation are present, as described in the current Urlwatch documentation.
  • Alerts report routine noise: inspect the filtered output, refine the filter, and use the documented --test-filter workflow to check the result before relying on notifications.
  • Authentication requires more than a cookie: Urlwatch’s general job documentation does not promise a universal automated path for site-specific login challenges. Check whether an appropriate API, a maintainable custom hook, or another authorized approach is available.

Configure notifications after retrieval works

Urlwatch’s role is to compare retrieved output with saved output and notify you of changes. Its handbook lists reporting options including email, Slack, Matrix, Discord, Telegram, and ntfy; these deliver alerts but do not solve authentication or ensure that the monitored response is the right page (Urlwatch handbook and documentation; Urlwatch project).

Or skip the browser setup

ScreenshotNeo is a website screenshot API and MCP server for developers. A single request can return a screenshot or PDF, but a screenshot is not a substitute for Urlwatch’s change comparison and notifications. For pages you are authorized to capture, it can avoid maintaining your own browser setup; it does not promise to access pages that require your login.

Example cURL request (replace the target URL and use your API key):

Rank #4
Dualcomm Raspberry Pi Network TAP Appliance
  • Portable 100M/1G Network TAP Appliance for remote capture of data traffic
  • Integrated with a Raspberry Pi 4 module (8GB RAM and 64GB Micro SD Card)
  • Can be used as a standalone 100M/1G network TAP with the external monitor port
  • Dual DC power inputs for enhancing overall system availability
curl -G "https://api.screenshotneo.com/v1/shot" -d access_key=YOUR_API_KEY --data-urlencode url=https://stripe.com -o shot.webp

See the ScreenshotNeo API documentation for request options. ScreenshotNeo removes cookie/consent banners, newsletter popups, and chat widgets before capture; bot checks, blank pages, and failed loads are never billed. Its MCP server lets AI agents take screenshots. The free plan includes 1,000 screenshots a month with no card; paid plans start at $5 for 3,000. Learn about ScreenshotNeo or sign up for 1,000 free screenshots a month, with no card.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Frequently Asked Questions

Can Urlwatch log in with a username and password automatically?

The documented custom-login example is a commented, hook-based illustration, not a built-in general-purpose login feature. Whether a login flow can be automated depends on the site and any custom code required.

Does receiving notifications mean the page is still authenticated?

No. Notifications report changes in retrieved output. Inspect the job output for a login page or expired-session response so that loss of access is not mistaken for a page change.

Quick Recap

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Developer ToolsPlaywrighturlwatchweb monitoring

Leave a Reply

Your email address will not be published. Required fields are marked *

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Recommended PC Tool
Recommended PC Tool
Crashes, No Sound, or Screen Glitches?Free driver scan
PC Slower Than It Used to Be?Free scan - under a minute

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.