DriversRecommendedOutdated drivers can make a good PC feel brokenScan driver issues before chasing fixes manually.Scan NowOctober DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsPC HealthRecommendedCrashes, freezes, slowdowns? Check your PC nowSpot repairable issues before they interrupt work.Check PC×
Skip to content
World desk4 min

How to Save Websites in ArchiveBox from a URL List

Feed a text file of URLs to ArchiveBox with standard input, or use the equivalent Docker and Compose commands. Learn what gets saved and how to troubleshoot imports.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

To save the pages listed in a text file, run archivebox add < urls_to_archive.txt from your ArchiveBox data directory. ArchiveBox reads URLs from standard input and creates local snapshots. You can also pipe the file into archivebox add; Docker and Docker Compose support the same basic workflow.

Prepare ArchiveBox and your URL list

Install and initialize ArchiveBox using the official instructions for your chosen setup before importing pages. The supported installation and platform guidance can change between releases; the official Quickstart describes support for macOS and Ubuntu on amd64 or arm64, and Docker on Linux and macOS, while noting that other operating systems were not tested for that release.

As an Amazon Associate I earn from qualifying purchases.

Create a plain-text file such as urls_to_archive.txt with one page URL per line:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
https://example.com/
https://example.org/about

Use full URLs, including the scheme (https:// or http://). Save the file somewhere you can reference from the ArchiveBox data directory, or use its full path in the command.

#1 Best Overall
Sale
Seagate 2TB Portable Hard Drive | USB 3.0 (STGX2000400) | Everyday HDD storage. Plug-and-play backup. Windows & macOS. Adobe CC trial included. 1-Year Warranty
  • Easily store and access 2TB to content on the go with the Seagate Portable Drive, a USB external hard drive
  • Designed to work with Windows or Mac computers, this external hard drive makes backup a snap just drag and drop
  • To get set up, connect the portable hard drive to a computer for automatic recognition no software required
  • This USB drive provides plug and play simplicity with the included 18 inch USB 3.0 cable
  • The available storage capacity may vary.

Import the list from a terminal

  1. Open a terminal in your ArchiveBox data directory.

  2. Run:

    archivebox add < urls_to_archive.txt
  3. Wait for ArchiveBox to process the submitted pages. Then inspect the archive directory or use the web interface to view the resulting snapshots.

The equivalent pipe form is:

cat urls_to_archive.txt | archivebox add

Both commands feed the file contents to ArchiveBox through standard input. For a list stored elsewhere, provide its path, for example archivebox add < ~/Downloads/urls_to_archive.txt.

Run the same import with Docker

For plain Docker, the official Quickstart demonstrates passing the URL list on standard input with -i:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
docker run -v $PWD:/data -i archivebox/archivebox:dev add < your_urls.txt

Here, the current directory is mounted as /data, so run the command in the directory you intend to use for ArchiveBox data. The -i option keeps standard input open so the container can read the redirected file.

Rank #2
Seagate Portable 5TB External Hard Drive HDD – USB 3.0 for PC, Mac, PS4, & Xbox - 1-Year Rescue Service (STGX5000400), Black
  • Easily store and access 5TB of content on the go with the Seagate portable drive, a USB external hard Drive
  • Designed to work with Windows or Mac computers, this external hard drive makes backup a snap just drag and drop
  • To get set up, connect the portable hard drive to a computer for automatic recognition software required
  • This USB drive provides plug and play simplicity with the included 18 inch USB 3.0 cable
  • The available storage capacity may vary.

With Docker Compose, use the documented -T option to disable pseudo-TTY allocation for the redirected input:

docker compose run --rm -T archivebox add < your_urls.txt

These examples use the image and service names shown in the Quickstart. If your installation uses a different Compose service or image configuration, substitute the names from your setup while preserving the standard-input handling.

Import bookmarks and feeds, not just text files

ArchiveBox can extract URLs from other URL-bearing inputs as well. The Usage guide demonstrates importing RSS or XML feeds and bookmark exports, including Netscape-format HTML and JSON. For example:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
archivebox add < ~/Downloads/bookmarks_export.html
archivebox add < ~/Downloads/pinboard_bookmarks.json

You can also pass a feed URL to archivebox add, as shown in the Quickstart. These inputs are parsed for URLs; they do not need to be converted into a hand-written one-URL-per-line file first.

Rank #3
Seagate Portable 1TB External Hard Drive HDD – USB 3.0 for PC, Mac, PlayStation, & Xbox, 1-Year Rescue Service (STGX1000400) , Black
  • Easily store and access 1TB to content on the go with the Seagate Portable Drive, a USB external hard drive.Specific uses: Personal
  • Designed to work with Windows or Mac computers, this external hard drive makes backup a snap just drag and drop. Reformatting may be required for Mac
  • To get set up, connect the portable hard drive to a computer for automatic recognition no software required
  • This USB drive provides plug and play simplicity with the included 18 inch USB 3.0 cable
  • The available storage capacity may vary.

Choose whether to archive only submitted URLs or follow links

A plain URL-list import submits the listed pages; it does not ask ArchiveBox to crawl links from them. If you deliberately want the submitted URL and links one hop away, add --depth=1:

archivebox add --depth=1 < urls_to_archive.txt

This increases the scope beyond the pages in your input file. Use it only when that broader capture is intended.

Find and understand the saved snapshots

ArchiveBox stores snapshots as files in its local archive. Depending on the page and the extractors configured, a snapshot may include formats such as HTML, PDF, PNG, JSON, or WARC. Do not expect every format for every URL: the available outputs depend on the page and configuration.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The Quickstart points to the archive directory for archive data and describes the web interface as another way to browse it. Keep the whole collection backed up. ArchiveBox’s installation guidance recommends backing up the full collection before upgrading.

Rank #4
Seagate Portable 4TB External Hard Drive HDD – USB 3.0, 1-Year Rescue
  • Easily store and access 4TB of content on the go with the Seagate Portable Drive, a USB external hard drive.Specific uses: Personal
  • Designed to work with Windows or Mac computers, this external hard drive makes backup a snap just drag and drop
  • To get set up, connect the portable hard drive to a computer for automatic recognition no software required
  • This USB drive provides plug and play simplicity with the included 18 inch USB 3.0 cable
  • The available storage capacity may vary.

Troubleshoot common URL-list import problems

  • archivebox: command not found: The command is not available in the current shell or environment. Confirm that ArchiveBox is installed for the setup you chose, then run the command in that environment and from the data directory.

  • The command reports no URLs or imports nothing: Check that the file path is correct, that the file contains actual URLs, and that the redirection operator points into the command: archivebox add < urls_to_archive.txt.

  • Docker does not receive the file: Use the stdin-related options shown in the official examples: -i for docker run and -T for docker compose run. Also confirm the working directory and mounted data path are the ones you intend.

    Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • Some pages do not produce the expected files: Snapshot outputs vary by page and configured extractors. A missing PDF, image, or other format does not by itself mean that every part of the import failed.

    Best Value
    Sale
    UnionSine 500GB Ultra Slim Portable External Hard Drive HDD-USB 3.0
    • [Upgraded Version] - This external hard drive features a mirrored logo stripe combined with a striped anti-slip design, and the rounded corners of the casing make it easier to grip. The stripes also have a heat dissipation function, ensuring stable and fast data transfer.
    • 【Ultra-thin and quiet】 - The motherboard adopts JMicron 578 noise-free solution, giving you a quiet working environment. Lightweight and portable size designed to fit in your pocket for easy portability.
    • 【Ultra-Fast Data Transfers】 - Pairing this external hard drive with JMicron 578 solution USB 3.0 and USB 2.0 interfaces enables blazing-fast data transfer. It boasts theoretical read speeds of up to 125MB/s and write speeds of up to 103MB/s.
    • 【Plug and Play】 - With no software to install, just plug it in and the drive is ready to use.The hard disk chip is wrapped with an aluminum anti-interference layer to increase heat dissipation and protect data.
    • 【What You Get】 - 1 x Portable Hard Drive, 1 x USB 3.0 Cable, 1 x User Manual, Gift-type shell packaging ,Three-year manufacturer's warranty and free technical support services.
  • You expected linked pages to be included: A basic URL-list import does not request link crawling. Add --depth=1 only if you want one-hop links included.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Or skip the browser setup

ArchiveBox saves local snapshots; ScreenshotNeo is a separate screenshot API for returning an image or PDF from a URL, not a replacement for a local ArchiveBox collection. Its one-call API example is:

curl -G "https://api.screenshotneo.com/v1/shot" -d access_key=YOUR_API_KEY --data-urlencode url=https://example.com -o shot.webp

See the ScreenshotNeo API documentation for request options. ScreenshotNeo accepts cookie or consent banners and removes more than 60 known consent platforms, newsletter popups, and chat widgets before capture; each of those steps can be turned off. Bot checks or CAPTCHAs, blank pages, timeouts, failed loads, and cache hits cost nothing, and response headers report the page verdict and billing status. Its MCP server provides take_screenshot, get_page_info, and capture_pdf tools for AI agents and MCP clients. The free plan includes 1,000 screenshots per month with no card; paid plans start at $5 for 3,000 screenshots.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Sign up for ScreenshotNeo’s free plan: 1,000 screenshots a month, no card required.

Frequently Asked Questions

Does ArchiveBox save every URL as a PDF?

No. Snapshot formats depend on the page and the extractors configured; a PDF is not guaranteed for each URL.

Can I import a bookmark export without converting it to a text list?

Yes. ArchiveBox can parse URL-bearing inputs such as Netscape-format bookmark HTML and JSON exports.

Quick Recap

SaleBestseller No. 1
Seagate 2TB Portable Hard Drive | USB 3.0 (STGX2000400) | Everyday HDD storage. Plug-and-play backup. Windows & macOS. Adobe CC trial included. 1-Year Warranty
Seagate 2TB Portable Hard Drive | USB 3.0 (STGX2000400) | Everyday HDD storage. Plug-and-play backup. Windows & macOS. Adobe CC trial included. 1-Year Warranty
This USB drive provides plug and play simplicity with the included 18 inch USB 3.0 cable; The available storage capacity may vary.
$129.99
Bestseller No. 2
Seagate Portable 5TB External Hard Drive HDD – USB 3.0 for PC, Mac, PS4, & Xbox - 1-Year Rescue Service (STGX5000400), Black
Seagate Portable 5TB External Hard Drive HDD – USB 3.0 for PC, Mac, PS4, & Xbox - 1-Year Rescue Service (STGX5000400), Black
This USB drive provides plug and play simplicity with the included 18 inch USB 3.0 cable; The available storage capacity may vary.
$229.99
Bestseller No. 3
Seagate Portable 1TB External Hard Drive HDD – USB 3.0 for PC, Mac, PlayStation, & Xbox, 1-Year Rescue Service (STGX1000400) , Black
Seagate Portable 1TB External Hard Drive HDD – USB 3.0 for PC, Mac, PlayStation, & Xbox, 1-Year Rescue Service (STGX1000400) , Black
This USB drive provides plug and play simplicity with the included 18 inch USB 3.0 cable; The available storage capacity may vary.
$119.80
Bestseller No. 4
Seagate Portable 4TB External Hard Drive HDD – USB 3.0, 1-Year Rescue
Seagate Portable 4TB External Hard Drive HDD – USB 3.0, 1-Year Rescue
This USB drive provides plug and play simplicity with the included 18 inch USB 3.0 cable; The available storage capacity may vary.
$208.99

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Leave a Reply

Your email address will not be published. Required fields are marked *

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Windows Errors? Fix Them Before They SpreadFree repair scan
Crashes, No Sound, or Screen Glitches?Free driver scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.