Recommended Free Tools
Serving Markdown alongside HTML drew two distinct kinds of traffic to one website: `.md` URLs were used mainly by corpus crawlers, while HTTP content negotiation was used mainly by agent-oriented answer tools and a coding agent. In a two-week window in September 2026, Dominique Siacci measured about 80,000 requests to Markdown URLs and about 22,500 requests carrying `Accept: text/markdown`. Those are observations from one site—not a forecast of how agents behave across the web.
What Siacci measured—and what the counts mean
Dominique Siacci, a GoodBarber co-founder and engineering lead, reports the figures in his September 24, 2026 DEV Community article. The measurement covered September 4–18, 2026, using dedicated application-server logs for `.md` requests and requests whose `Accept` header contained `text/markdown`. Siacci converted the logged timestamps from Paris time to UTC.
As an Amazon Associate I earn from qualifying purchases.
In his method, a request is one log line. A visitor is the combination of IP address, user agent, and UTC day, so it is not necessarily a unique person. Siacci excluded internal test tools and eight internal addresses regardless of user-agent value. Totals are approximate; a request does not prove that a client successfully read or used the content.
Free tools Windows power users keep installed
One-click scans. No signup required.
| Request path | Reported volume | Reported response result | Interpretation |
|---|---|---|---|
| `.md` URL suffix | About 80,000 requests, from about 5,800 addresses and 20,000 visitors; around 26,000 host-and-path pairs | 93.8% returned HTTP 200 | Siacci observed use by corpus crawlers, including GPTBot following the site’s alternate link. |
| `Accept: text/markdown` | About 22,500 requests, from about 5,700 addresses and 6,700 visitors; roughly two-thirds GET and one-third HEAD | 52.7% returned HTTP 200; about 10,500 were redirects, including approximately 8,500 missing-trailing-slash redirects | Siacci observed heavier use by agent-oriented answer tools and a coding agent. The raw 200 rates are not directly comparable because redirect overhead differed. |
For negotiated requests, Siacci inferred whether a Markdown response was delivered by comparing its size with the `.md` twin. He notes that logging `$sent_http_content_type` alongside status would identify the response type directly. His broader front-end syslog covered May through September 18, 2026—about 260 million lines—and was used for contextual traffic analysis, not as a measure of Markdown responses alone.
#1 Best Overall
- Includes Raspberry Pi 5 with 2.4Ghz 64-bit quad-core CPU (8GB RAM)
- Includes 128GB Micro SD Card pre-loaded with 64-bit Raspberry Pi OS, USB MicroSD Card Reader
- CanaKit Turbine Black Case for the Raspberry Pi 5
- CanaKit Low Noise Bearing System Fan
- Mega Heat Sink - Black Anodized
How the site served Markdown from existing HTML
The site is a Django application behind nginx with a full-page cache. Rather than maintaining separate Markdown templates or a second manually edited content source, Siacci’s middleware converts the HTML response already in the cache. It performs conversion once per distinct HTML response and caches the result using a fingerprint of that HTML. Its position in the middleware chain allows it to act before later minification and CSRF placeholder substitution.
Two request paths to the same converted page
- Content negotiation: A client requests the regular URL with `Accept: text/markdown`. When the header’s quality values prefer Markdown, the same URL returns Markdown and includes `Vary: Accept` so caches distinguish representations.
- `.md` suffix: A client appends `.md` to a public path, such as `/pricing.md` or `/blog/<slug>.md`. The root page is available at `/index.md`. The route resolves to the canonical path and uses the same middleware as negotiation.
Eligible HTML pages advertise the Markdown version with both an HTML `rel=”alternate”` link and an HTTP `Link` header. The Markdown response includes YAML front matter for the title, description, canonical URL, and dates sourced from JSON-LD; it also links back to the canonical page and returns `X-Robots-Tag: noindex`. Unknown `.md` paths receive a Markdown 404 document. The implementation excludes 24 back-office and partial routes.
Reported implementation checks and related output
Siacci says he fetched three pages with the feature both enabled and disabled using seven client types, producing 21 responses that were byte-identical. He reports roughly eight microseconds of additional per-request processing for browsers. These are his implementation checks and measurements, not an independent benchmark.
Rank #2
- Includes Raspberry Pi 5 16GB with 2.4Ghz 64-bit quad-core CPU (16GB RAM)
- Includes 128GB Micro SD Card pre-loaded with 64-bit Raspberry Pi OS, USB MicroSD Card Reader
- CanaKit Turbine Black Case for the Raspberry Pi 5
- CanaKit Low Noise Bearing System Fan
- Mega Heat Sink - Black Anodized
The same conversion also feeds nightly generation of `llms.txt` and `llms-full.txt` in eleven languages, with local currency forced according to country. Siacci reports about 1,200 requests for `llms.txt` since early August, of which roughly one hundred were attributed to declared AI-operator crawlers or fetchers.
Which clients used which path
Siacci reports that about 80% of negotiated requests came from ShapBot and ExaSearchBot. Their identities were treated as declared rather than verified: neither had published IP ranges in the method he describes. The `.md` URLs, by contrast, attracted corpus crawlers in this site’s logs. These patterns describe this domain and its discovery links during the measured period; they do not establish how other sites or clients will behave.
Coding and answer tools
About 1,400 requests were identified as Claude Code. Siacci reports that it sent the Markdown `Accept` header on 99.1% of its page requests; Markdown was received in 97.7% of cases where the response could be determined. Three quarters of those requests were to the help center.
Rank #3
- CanaKit Raspberry Pi 5 Essentials Starter Kit
Siacci also counted about 10,000 ChatGPT-User, 2,700 hosted Claude-User, and 900 Perplexity-User HTML page fetches. One Markdown or negotiated fetch among those was his own ChatGPT test. The observed HTML fetches do not reveal what an assistant did with the content afterward, and the logs cannot establish how any system processes HTML once it has fetched it.
What’s actually slowing this PC down?
Pick the symptom - the matching free tool is one click away.
Identity checks and uncertainty
A user-agent string alone does not prove that a request came from the named bot. Siacci checked identities against operator-published IP ranges downloaded once and dated, or used forward-confirmed reverse DNS for some crawlers. Anthropic published no ranges in the method described, so ClaudeBot identity was inferred from traffic blocks in the site’s logs and treated as declared, not proven. ShapBot and ExaSearchBot were also treated as declared. Operator address ranges can change; Siacci notes that an OpenAI list changed on the day it was downloaded, which makes the dated snapshot important when reproducing the analysis.
What the response-size comparison does—and does not—show
Across about 22,000 pages, Siacci reports a 78.7% reduction in median Markdown response size; on the help center, the reduction was 83.9%. These figures refer to bytes on the wire, including compression when accepted. They are not measurements of token savings, reading quality, model performance, or total infrastructure cost.
Rank #4
- All-in-One Complete Kit: This SANOOV RPi 5 bundle comes with Raspberry Pi 5 4GB RAM single board, active cooler, durable ABS case and screwdriver. No extra parts needed, ready to use right out of the box for beginners and hobbyists
- Powerful Single Board Computer: Equipped with 4GB RAM and high-performance processor, delivers fast running speed for 4K playback, AI projects, programming and daily computing tasks. SANOOV for raspberry pi 5 4GB is equipped with broadcom 64 quad-core Arm Cortex A76 processor with gigabit ethernet and upgraded with IEEE 802.11ac Wi-Fi, Bluetooth 5.0 dual-band 2.4Ghz and 5Ghz and Power Over Ethernet (POE). Upgrading delivers 2-3 x speed vs Pi 4, redefining the experience
- Efficient Active Cooler: Effectively lowers operating temperature and prevents performance throttling. Runs quietly even under long-time heavy load, ensures stable operation all day long. SANOOV RPi 5 4GB kit offer an active cooler, which combines an aluminium heatsink with a high-performance PWM fan. Active cooler is fully compatible with the Pi OS, which can effectively reduce the temperature of RPi5 and ensure its good performance during long-term high load operation
- Sturdy ABS Protective Case: Well-fitted for Raspberry Pi 5 board, can be secured with 4 screws to effectively protect the Pi 5 motherboard from damage, reserves full access to all ports and buttons. SANOOV uses ABS material to produce the case, which has a softer texture and feel. Meanwhile, SANOOV case adopts a layered design for easy disassembly and installation. (Tip: The Case cannot install M.2 HAT Add on Board and Solid State Drive!)
- Wide Application & Full Compatibility: Seamlessly compatible with official OS and mainstream peripheral accessories for Raspberry Pi 5. Whether you are a beginner, student, electronics hobbyist or professional developer, this all-in-one kit meets your diverse needs. It excels in IoT projects, robotics design, retro gaming devices, home media servers and other DIY creations. Backed by a large global community, you can easily find guides, technical support and shared projects online
The result supports a practical observation: returning Markdown can transfer fewer bytes than returning HTML for these pages under the reported conditions. It does not show that every client needs Markdown, or that the same reduction will occur on a different site with different markup, content, and compression behavior.
What a two-week log window cannot establish
- General agent behavior: One website, one implementation, and a short observation period cannot predict adoption across the web or show that crawler behavior will persist.
- What assistants do with fetched pages: Human-question assistants continued to fetch HTML in the observed window. They may convert it on their side, but the logs cannot show how fetched content is processed.
- Verified identity for every named bot: Some identities were only declared, and IP ranges can rotate.
- Demand from earlier probes: Before September 4, the site saw about 900 unsuccessful `.md` probes over three and a half months, many for repository-style paths such as `README.md`, `agents.md`, and `CLAUDE.md`. Those failures do not establish demand for the site’s eventual Markdown twins.
Practical lessons for serving Markdown
Keep the content source and cache relationship clear
Generating Markdown from cached HTML can avoid maintaining duplicate content, as Siacci’s implementation illustrates. If negotiation is supported, `Vary: Accept` is important to keep caches from mixing HTML and Markdown representations. A suffix route offers a separate URL path but requires deliberate routing and fallback behavior.
Make discovery, canonicalization, and errors explicit
Advertise eligible alternates, point Markdown back to the canonical HTML URL, and decide how non-page routes and missing paths respond. Siacci’s setup used both HTML and HTTP alternate declarations, front matter for page metadata, a noindex header for Markdown, and a Markdown-formatted 404.
Best Value
- 【What you Get】You will get 1*Pi 5 8GB Single Board,1*RasTech Case,1*Active Cooler,1*Screwdriver,1*Installation instructions,12-month free warranty, lifetime service, 24-hour prompt and friendly response.
- 【More Connectors】There are two USB 3.0 ports(5Gbps simultaneously) and two USB 2.0 ports, which triple total bandwidth ,support any combination of up to two cameras or displays. Peak SD card performance is doubled through support for the SDR104 high-speed mode. It provides a smooth desktop experience for you. Offer Gigabit Ethernet and a PCIe interface, along with dual-band Wi-Fi and Bluetooth 5.0/BLE wireless capability. The RasTech Pi 5 Kit use the new 27W 5.1V 5A USB-C power connector.
- 【 Support Dual 4Kp60 Display 】Each of the two microHDMI sockets can control a 4K display at 60 Hertz, now support HDR, offering super HD video for media streaming projects. RPi 5 is the first RPi model that comes with a PCI Express port (PCIe 2.0 x1 with 500 MB/s) to attach SSDs (requires separate M.2 HAT).
- 【 Excellent Chips And Applications】Pi 5 is a full-size Pi computer using silicon built in-house at Pi. The RP1 “southbridge” provides the bulk of the I/O capabilities for Pi 5. Pi 5 is more friendly and convenient in the development of Internet of Things, Web development, machine identification, automatic control and other electronic equipment applications and network.
- 【 Faster CPU, Better GPU 】 Pi 5 features a Broadcom BCM2712 64-bit quad-core Arm Cortex-A76 processor running at 2.4GHz, it delivers a 2–3× increase in CPU performance relative to RaspberryPi 4. The 800MHz VideoCore VII GPU is compatible to OpenGL ES 3.1 and Vulkan 1.2, substantial uplift in graphics performance. Pi 5 Offers lightning-fast CPU speed, a PCI Express interface, a Real Time Clock (RTC) and a power button and runs significantly cooler than Pi 4.
Instrument the response, not just the request
Measure suffix and negotiated traffic separately. Log enough to connect request path and `Accept` header with status, content type, response size, and relevant client fields; logging `$sent_http_content_type` alongside status avoids relying on response-size inference to identify the negotiated representation. Exclude internal tests explicitly so a team’s own tools do not inflate adoption counts.
Report identity confidence honestly
Where available, use operator-published address ranges or documented DNS verification, and preserve the date of any range snapshot used. Label user-agent-only or otherwise unverified identities as declared rather than confirmed. This keeps a traffic report from turning a client’s self-description into a verified fact.
Quick Recap
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
Quick wins for a faster PC:
Repair Windows errors before they cause bigger problemsFix Now →Fix the driver behind crashes, sound loss and screen glitchesFind Drivers →Clear out junk files and repair common Windows errorsFree Scan →
