Driver FixRecommendedSound, Wi-Fi or graphics acting up? Check drivers firstFind missing or outdated drivers fast.Check DriversHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsClean PCRecommendedOne scan can reveal what keeps slowing WindowsLook for cleanup and repair opportunities.Run Scan×
FREEDOM251

Freedom251 › Blog › Command Line

How to Export Urlwatch Results and Keep a History of Page Changes

By Freedom251 Team · · 5 min read

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Urlwatch has three different kinds of “export”: save the report from a run, dump cached history for one job, or retain the cache database that Urlwatch uses to compare page changes. For a report, redirect standard output with urlwatch > report.txt. For one job’s prior data, use urlwatch --dump-history JOB. To keep Urlwatch’s comparison history available, preserve its configured cache file and avoid removing older entries with cache cleanup.

Choose what you want to save

Need Method What you get Important limit
Save this run’s report urlwatch > report.txt A text file containing output written to standard output for that invocation. It is a report artifact, not the underlying history database.
Inspect one monitored job’s past data urlwatch --dump-history JOB Historical cached data for the selected job. The command is per-job; the reference does not define it as a complete cache export format.
Keep Urlwatch’s comparison history Retain the configured cache database. Job state history used by Urlwatch for diffing. Cache cleanup can delete older entries.

The command details and cache defaults below correspond to Urlwatch 2.29 documentation and Debian’s Urlwatch 2.29-1 manpage. Check the current Urlwatch handbook and the help output for your installed version if a label, default, or behavior differs.

As an Amazon Associate I earn from qualifying purchases.

Save a report from a Urlwatch run

Urlwatch’s reporter system writes to standard output by default. Use your shell’s output redirection to save that run’s report:

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
urlwatch > report.txt

This replaces report.txt if it already exists. To append each run’s output instead, use the shell’s append operator:

#1 Best Overall
CanaKit Raspberry Pi 5 Starter Kit PRO - Turbine Black (128GB Edition) (8GB RAM)
  • Includes Raspberry Pi 5 with 2.4Ghz 64-bit quad-core CPU (8GB RAM)
  • Includes 128GB Micro SD Card pre-loaded with 64-bit Raspberry Pi OS, USB MicroSD Card Reader
  • CanaKit Turbine Black Case for the Raspberry Pi 5
  • CanaKit Low Noise Bearing System Fan
  • Mega Heat Sink - Black Anodized
urlwatch >> report.txt

Appending creates a sequence of run reports in a text file; it does not create a structured archive of snapshots or alter Urlwatch’s cache. If you need notifications somewhere other than standard output, Urlwatch supports configured reporters. The reporter reference lists integrations such as email, shell, Slack, Telegram, Matrix, and Discord; consult the current documentation for each reporter’s setup and dependencies.

Dump cached history for one job

Use --dump-history with the job identifier accepted by your installed version:

urlwatch --dump-history JOB

To save the command’s output to a separate text file:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #2
CanaKit Raspberry Pi 5 16GB Starter Kit PRO - Turbine Black (128GB Edition) (16GB RAM)
  • Includes Raspberry Pi 5 16GB with 2.4Ghz 64-bit quad-core CPU (16GB RAM)
  • Includes 128GB Micro SD Card pre-loaded with 64-bit Raspberry Pi OS, USB MicroSD Card Reader
  • CanaKit Turbine Black Case for the Raspberry Pi 5
  • CanaKit Low Noise Bearing System Fan
  • Mega Heat Sink - Black Anodized
urlwatch --dump-history JOB > job-history.txt

This dumps historical cached data for the selected job. It is not documented as an export of every job or as a portable, version-independent archive with a guaranteed schema. Confirm the job identifier format for your version before running it; relevant Urlwatch commands can select jobs by location or index.

Keep the cache that Urlwatch uses for comparisons

Urlwatch stores job state history for diffing in a SQLite 3 database. The documented default path is $XDG_CACHE_HOME/urlwatch/cache.db. If XDG_CACHE_HOME is not set, the actual resolved location depends on the XDG cache convention on your system. You can choose a different file with the --cache FILE option.

To keep comparison history, preserve the cache file Urlwatch is configured to use. If you use a custom location, retain that file rather than assuming the default path contains your data. The documented CLI reference does not specify a complete procedure for copying a live database safely, restoring it across versions, or exporting all records to an interchange format. For a straightforward supported workflow, keep the cache file and use --dump-history when you need to inspect a particular job.

Rank #3
CanaKit Raspberry Pi 5 Essentials Starter Kit (4GB RAM)
  • CanaKit Raspberry Pi 5 Essentials Starter Kit

Prevent cleanup from shortening retained history

The --gc-cache RETAIN_LIMIT option removes older cache entries while retaining the latest requested number. The documented default retain limit is one. If you want older snapshots to remain available, check whether your run or scheduled command invokes cache cleanup and verify the retain limit before executing it.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Cache cleanup is distinct from saving reports: deleting old cache entries can reduce the history Urlwatch can use for comparisons, while a previously redirected text report remains a separate file.

Change a monitored location without losing its history

Urlwatch keys a job’s history by its url value. If you edit the URL directly in urls.yaml, Urlwatch treats it as a new job with no prior history. When a page moves and you want to keep the existing job history, use the documented migration command:

Rank #4
SANOOV Raspberry Pi 5 4GB Kit, 4GB RAM Single Board Computer with Active Cooler and ABS Case, Complete Raspberry Pi 5 Starter Kit for IoT Robotics Retro Gaming
  • All-in-One Complete Kit: This SANOOV RPi 5 bundle comes with Raspberry Pi 5 4GB RAM single board, active cooler, durable ABS case and screwdriver. No extra parts needed, ready to use right out of the box for beginners and hobbyists
  • Powerful Single Board Computer: Equipped with 4GB RAM and high-performance processor, delivers fast running speed for 4K playback, AI projects, programming and daily computing tasks. SANOOV for raspberry pi 5 4GB is equipped with broadcom 64 quad-core Arm Cortex A76 processor with gigabit ethernet and upgraded with IEEE 802.11ac Wi-Fi, Bluetooth 5.0 dual-band 2.4Ghz and 5Ghz and Power Over Ethernet (POE). Upgrading delivers 2-3 x speed vs Pi 4, redefining the experience
  • Efficient Active Cooler: Effectively lowers operating temperature and prevents performance throttling. Runs quietly even under long-time heavy load, ensures stable operation all day long. SANOOV RPi 5 4GB kit offer an active cooler, which combines an aluminium heatsink with a high-performance PWM fan. Active cooler is fully compatible with the Pi OS, which can effectively reduce the temperature of RPi5 and ensure its good performance during long-term high load operation
  • Sturdy ABS Protective Case: Well-fitted for Raspberry Pi 5 board, can be secured with 4 screws to effectively protect the Pi 5 motherboard from damage, reserves full access to all ports and buttons. SANOOV uses ABS material to produce the case, which has a softer texture and feel. Meanwhile, SANOOV case adopts a layered design for easy disassembly and installation. (Tip: The Case cannot install M.2 HAT Add on Board and Solid State Drive!)
  • Wide Application & Full Compatibility: Seamlessly compatible with official OS and mainstream peripheral accessories for Raspberry Pi 5. Whether you are a beginner, student, electronics hobbyist or professional developer, this all-in-one kit meets your diverse needs. It excels in IoT projects, robotics design, retro gaming devices, home media servers and other DIY creations. Backed by a large global community, you can easily find guides, technical support and shared projects online
urlwatch --change-location https://old.example/page https://new.example/page

The command also handles browser and shell jobs by changing their navigate or command value, respectively. Use the old and new locations that match the job you are migrating.

Common problems and fixes

  • The report file is empty or missing expected content. Check that the command completed and that you are looking at standard output. Urlwatch’s reporters can be configured to send reports through other channels, so inspect the reporter configuration if output is not going to stdout.
  • The history dump does not recognize the job. Confirm the identifier syntax for the installed version and use the job’s configured location or supported index as appropriate. The option dumps history for a selected job, not the entire cache.
  • A changed URL has no old snapshots. Editing the URL directly creates a new job identity. Use --change-location OLD NEW to migrate the location while retaining history.
  • Older entries have disappeared. Check whether --gc-cache was run and what retain limit was used; the documented default is one retained entry.
  • The expected cache file is not at the default location. Check the --cache FILE argument and the value of XDG_CACHE_HOME in the environment used to run Urlwatch. A scheduled job may run with a different environment from your interactive shell.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Or skip the browser setup

Urlwatch monitors changes; if what you need instead is a clean screenshot of a page, ScreenshotNeo offers a one-request screenshot API. Its consent handling removes 60+ known consent platforms, newsletter popups, and chat widgets before capture, with each step independently switchable. Bot checks, blank pages, failed loads, timeouts, and cache hits are not billed, and responses identify page verdict and billing status in headers. It also provides an MCP server for AI agents, with take_screenshot, get_page_info, and capture_pdf tools.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

cURL example, using the documented endpoint and parameters:

Best Value
RasTech Raspberry Pi 5 8GB Kit with Active Cooler and Pi5 Case
  • 【What you Get】You will get 1*Pi 5 8GB Single Board,1*RasTech Case,1*Active Cooler,1*Screwdriver,1*Installation instructions,12-month free warranty, lifetime service, 24-hour prompt and friendly response.
  • 【More Connectors】There are two USB 3.0 ports(5Gbps simultaneously) and two USB 2.0 ports, which triple total bandwidth ,support any combination of up to two cameras or displays. Peak SD card performance is doubled through support for the SDR104 high-speed mode. It provides a smooth desktop experience for you. Offer Gigabit Ethernet and a PCIe interface, along with dual-band Wi-Fi and Bluetooth 5.0/BLE wireless capability. The RasTech Pi 5 Kit use the new 27W 5.1V 5A USB-C power connector.
  • 【 Support Dual 4Kp60 Display 】Each of the two microHDMI sockets can control a 4K display at 60 Hertz, now support HDR, offering super HD video for media streaming projects. RPi 5 is the first RPi model that comes with a PCI Express port (PCIe 2.0 x1 with 500 MB/s) to attach SSDs (requires separate M.2 HAT).
  • 【 Excellent Chips And Applications】Pi 5 is a full-size Pi computer using silicon built in-house at Pi. The RP1 “southbridge” provides the bulk of the I/O capabilities for Pi 5. Pi 5 is more friendly and convenient in the development of Internet of Things, Web development, machine identification, automatic control and other electronic equipment applications and network.
  • 【 Faster CPU, Better GPU 】 Pi 5 features a Broadcom BCM2712 64-bit quad-core Arm Cortex-A76 processor running at 2.4GHz, it delivers a 2–3× increase in CPU performance relative to RaspberryPi 4. The 800MHz VideoCore VII GPU is compatible to OpenGL ES 3.1 and Vulkan 1.2, substantial uplift in graphics performance. Pi 5 Offers lightning-fast CPU speed, a PCI Express interface, a Real Time Clock (RTC) and a power button and runs significantly cooler than Pi 4.
curl -G "https://api.screenshotneo.com/v1/shot" -d access_key=YOUR_API_KEY --data-urlencode url=https://stripe.com -o shot.webp

See the ScreenshotNeo API documentation for options and setup. ScreenshotNeo includes 1,000 screenshots per month free with no card; paid plans start at $5 for 3,000. Sign up for the free plan.

Frequently Asked Questions

Does redirecting Urlwatch output save the page snapshots?

No. Redirection saves the report text from that invocation; Urlwatch’s cache database holds the state history used for comparisons.

Can –dump-history export every Urlwatch job at once?

The documented command dumps cached history for a selected job. The reference does not describe it as a whole-cache export.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Will a normal URL edit keep a job’s old history?

No. Use `urlwatch –change-location OLD NEW` to change a monitored location while retaining its job history.

Quick Recap

Bestseller No. 1
CanaKit Raspberry Pi 5 Starter Kit PRO - Turbine Black (128GB Edition) (8GB RAM)
CanaKit Raspberry Pi 5 Starter Kit PRO - Turbine Black (128GB Edition) (8GB RAM)
Includes Raspberry Pi 5 with 2.4Ghz 64-bit quad-core CPU (8GB RAM); CanaKit Turbine Black Case for the Raspberry Pi 5
$259.95
Bestseller No. 2
CanaKit Raspberry Pi 5 16GB Starter Kit PRO - Turbine Black (128GB Edition) (16GB RAM)
CanaKit Raspberry Pi 5 16GB Starter Kit PRO - Turbine Black (128GB Edition) (16GB RAM)
Includes Raspberry Pi 5 16GB with 2.4Ghz 64-bit quad-core CPU (16GB RAM); CanaKit Turbine Black Case for the Raspberry Pi 5
Bestseller No. 3
CanaKit Raspberry Pi 5 Essentials Starter Kit (4GB RAM)
CanaKit Raspberry Pi 5 Essentials Starter Kit (4GB RAM)
CanaKit Raspberry Pi 5 Essentials Starter Kit
$189.99

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Command Linepage change historyurlwatchWeb developmentwebsite monitoring

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Recommended PC Tool
Recommended PC Tool
Windows Errors? Fix Them Before They SpreadFree repair scan
Crashes, No Sound, or Screen Glitches?Free driver scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.