DriversRecommendedOutdated drivers can make a good PC feel brokenScan driver issues before chasing fixes manually.Scan NowOctober DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsClean PCRecommendedOne scan can reveal what keeps slowing WindowsLook for cleanup and repair opportunities.Run Scan×
Skip to content
World desk5 min

Make Your Website Easier for AI Agents to Read with Markdown

A site can serve Markdown when a client requests it with Accept: text/markdown. Here’s how conversion, caching, and adjacent agent conventions differ.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Yes: a website can offer a Markdown version of a page when a client asks for it. With HTTP content negotiation, an agent sends Accept: text/markdown; supported infrastructure can then return a converted representation instead of HTML. This gives software a cleaner, more predictable input format, but it does not guarantee that agents will request it or improve the quality of their answers.

How Markdown for Agents works

Markdown for Agents is a way to serve a page in an alternate format, not a separate page or a new kind of crawler. The client requests a representation using an HTTP header, and the site or its delivery platform decides whether to provide it.

As an Amazon Associate I earn from qualifying purchases.

GET /fundamentals/reference/markdown-for-agents/ HTTP/2
Host: developers.cloudflare.com
Accept: text/markdown

Cloudflare documents a network-edge implementation for enabled zones: it retrieves the origin HTML, converts it when possible, and returns Markdown. Read the Docs documents automatic Markdown responses on its hosted documentation domains. In both cases, a normal browser can continue receiving HTML. Cloudflare’s Markdown for Agents documentation and Read the Docs’ Markdown documentation describe these respective approaches.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The practical idea is to avoid making each agent independently strip menus, scripts, and styling from rendered HTML. The available documentation describes this implementation goal; it does not establish better model accuracy, higher-quality answers, universal agent support, or a measured token-saving rate.

What can be in the Markdown response

Cloudflare documents a response that may combine several kinds of page information, rather than only plain body text:

  • Optional YAML frontmatter drawn from supported metadata tags.
  • The page’s converted Markdown body, with non-content elements such as navigation, scripts, and styles stripped during preprocessing.
  • A fenced JSON block containing source JSON-LD, when present.

For that implementation, the response uses Content-Type: text/markdown; charset=utf-8. Cloudflare also documents adding Accept to the Vary header, recalculating Content-Length, and including estimated x-markdown-tokens and x-original-tokens headers. Those token counts are response metadata; the example values in the documentation are not a general benchmark.

Cloudflare says it preserves existing security and cache-relevant origin headers, but removes body-specific headers such as ETag and Last-Modified, since conditional requests cannot be honored for the converted response. If an origin does not supply a Content-Signal header, Cloudflare documents adding the default Content-Signal: ai-train=yes, search=yes, ai-input=yes; an origin-provided value remains authoritative. Review and set the origin’s preferred policy before enabling the feature. This describes header behavior, not its legal effect.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

How to choose an implementation

The right path depends on where you want conversion to happen and how much control you need. Cloudflare and Read the Docs are documented examples, not an exhaustive list of ways to deliver Markdown.

Approach Where conversion happens Scope and control What to check
CDN or network-edge feature At the delivery network, after the origin provides HTML. May support a whole zone or selected hosts and paths, depending on the provider. Eligibility, configuration controls, Vary: Accept, metadata handling, cache behavior, and content-signal policy.
Documentation-hosting feature Within the documentation platform. Can be enabled by the host for its own documentation domains. Whether your site uses a supported hosted domain and what response behavior the platform documents.
Origin or application pipeline In your own application or publishing workflow. Potentially tailored to your site’s content and policies. How the alternate representation stays in sync with HTML, and whether caches vary by the requested media type.

For Cloudflare’s documented dashboard setup, the zone setting requires a Pro or Business plan. Its documentation also describes rules for selected hostnames or paths and an API route for changing the zone’s content_converter setting. These product details can change, so check the current Cloudflare documentation for eligibility and configuration before relying on a particular UI path. Read the Docs says Markdown delivery is enabled automatically on its hosted documentation domains; that is a platform-specific option, not a requirement for other sites.

Why cache variation matters

The same URL may now produce HTML for a browser and Markdown for a client that asks for it. A cache must not treat those representations as interchangeable. Cloudflare’s documented response adds Accept to Vary, allowing caches that honor the header to distinguish requests by the accepted media type.

If you implement conversion yourself, make sure the cache strategy reflects the representation choice; otherwise, one client could receive a response intended for another. Also account for the consequences of transformed content: a validator or modification date tied to the original HTML may not validate the converted body. Cloudflare’s documentation specifically describes removing ETag and Last-Modified for its converted response.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Markdown for Agents, llms.txt, and agents.txt are different

These conventions address separate jobs. A site can use more than one, but one does not replace the others.

Mechanism Its job What it does not do
Markdown for Agents Offers an alternate representation of a requested page, commonly through Accept: text/markdown. It does not itself declare agent capabilities or provide a curated site-wide content index.
llms.txt A proposed Markdown convention for a curated index of important site content. It is not a ratified web standard and does not grant or deny access, or protect pages left out of the index.
agents.txt A capability-declaration file describing protocols or endpoints a site supports. It is not the page’s alternate content representation or a content briefing index.

The llms.txt explainer, dated 2026-08-21, describes a v2 discovery approach using a rel="describedby" link and path-scoped indexes. It also says model vendors do not disclose whether their crawlers read the file, so adoption should not be assumed. The agents.txt project distinguishes capability declaration from content briefing. Access and use policies are handled separately from an llms.txt index.

What Markdown delivery does—and does not—make possible

Offering Markdown makes a page available in a representation some software may find easier to consume. It does not make a site universally readable to agents, compel clients to request Markdown, grant access to protected content, or establish what an agent may do with returned material. Discovery, access policy, and action capabilities remain separate concerns.

There is no topic-specific published adoption, performance, accuracy, or cost-savings figure in the reviewed provider documentation. Treat the feature as a content-delivery option: choose it when alternate-format delivery fits your infrastructure and policy, then verify that the returned content and cache behavior match your needs.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.