Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Some links on this page are affiliate links: if you buy through them we may earn a commission, at no extra cost to you.

Short version: On July 31, 2024, Reddit CEO Steve Huffman said Microsoft, Anthropic and Perplexity should negotiate paid agreements to use Reddit data. Huffman alleged that Microsoft had used Reddit material to train AI systems, summarize posts in Bing and make Reddit data available through a Bing API. Those were allegations, not findings established by a court or independent technical audit.

Reddit had also restricted Bing’s crawler, so newer Reddit discussions became much harder to find in Bing while Google continued to show Reddit results under a reported licensing arrangement. The episode exposed a larger conflict over whether public web pages are merely crawlable or valuable commercial data that search and AI companies must license.

What Reddit accused Microsoft of doing

In an interview with The Verge, Huffman said Reddit believed Microsoft had:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • used Reddit content to train Microsoft AI systems;
  • summarized Reddit material in Bing without Reddit’s knowledge; and
  • made Reddit data available to other search engines through a Bing API.

Huffman’s position was that companies benefiting from Reddit’s enormous archive of discussions should pay for access rather than treating every publicly viewable page as free commercial input. Microsoft declined to comment directly on the specific allegations in that report.

Reddit named Anthropic and Perplexity as well as Microsoft. Anthropic said Reddit had been on its crawler block list since mid-May 2024 and that it had not added Reddit URLs since then. Perplexity did not respond to The Verge’s request for comment.

What Microsoft said

Microsoft’s public account focused on crawling. Jordi Ribas, Microsoft’s head of search, said Reddit had blocked Bing’s crawler, which affected Bing and search engines powered by Bing while favoring another search provider.

Separately, Microsoft spokesperson Caitlin Roulston said Microsoft honored directions from websites that did not want their content used with Microsoft’s generative-AI models. That statement is not an admission that Microsoft used Reddit without permission, nor does it resolve Huffman’s claims about earlier access or specific Bing products.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Why Reddit wanted payment

Reddit’s business model was changing. Traditionally, a search engine crawled pages, indexed them and sent visitors back to the publisher. The traffic was the implicit exchange for access.

Rank #2
Dell Latitude 5420 14" FHD Business Laptop Computer, Intel Quad-Core i5-1145G7, 16GB DDR4 RAM, 256GB SSD, Camera, HDMI, Windows 11 Pro (Renewed)
  • 256 GB SSD of storage.
  • Multitasking is easy with 16GB of RAM
  • Equipped with a blazing fast Core i5 2.00 GHz processor.

AI search blurred that bargain. A system can retrieve Reddit discussions, summarize them in an answer and potentially satisfy the user without a visit to Reddit. A model can also use the material during training, creating value that is harder to measure in referrals. Reddit had already reached data-access agreements with Google and OpenAI and wanted other companies to negotiate comparable arrangements.

The commonly reported value of Google’s deal was approximately $50 million per year, although the cited coverage did not publish a complete contract. The price of Reddit’s OpenAI arrangement was not disclosed. Reddit spokesperson Tim Rathschmidt told The Verge that the deals completed at that point did not grant exclusive use cases.

Why Google could show Reddit while Bing could not

Reddit announced a robots.txt update on June 25, 2024. After the change, current Reddit pages were substantially restricted or absent from Bing, although older indexed links could remain visible. This should not be described as every Reddit URL being permanently deindexed.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Google’s continuing visibility was consistent with its reported licensing relationship with Reddit. That did not mean Google had an exclusive legal monopoly over Reddit content. A nonexclusive contract can nevertheless create an exclusive-looking experience if one major search engine has a data agreement and another is blocked from direct crawling.

Rank #3

Robots.txt is a crawler instruction, not a complete legal answer

robots.txt is a public file that tells compliant crawlers which parts of a site the publisher requests they not fetch. It can be an important technical signal, but it is not a universal copyright license or court ruling.

  • It does not automatically determine whether earlier copying was lawful.
  • It does not necessarily control authenticated API access, caches, syndicated material or data acquired from a partner.
  • It depends on the crawler respecting the instruction.
  • Reddit’s own help documentation says its robots.txt rules are for search engines, not Data API users.

Microsoft’s Bing Search API terms separately say API users must not use responses for websites whose content is restricted by that website, including where a crawler has been blocked through robots.txt. That is a product rule, not proof that every underlying Reddit use was authorized or unauthorized.

Scraping, indexing, summaries and training are different

Activity What happens Why it matters
Crawling A bot fetches pages. It is the technical act of accessing content.
Indexing A search engine stores information about pages. It enables links and discovery.
Search presentation or summarization A product displays or synthesizes material in an answer. It can reduce clicks and raise attribution and licensing questions.
Model training Data influences development or tuning of an AI model. It is a different technical and legal use from ordinary indexing.
API redistribution Data or search responses are supplied to another customer or service. Contractual limits may apply even when pages are publicly viewable.

A publisher might allow crawling for links while forbidding model training. Conversely, a paid agreement might authorize a controlled retrieval system while limiting retention, redistribution or general-purpose training. Calling all of these activities “scraping” hides the actual dispute.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The public-web argument is not settled law

Microsoft AI executive Mustafa Suleyman was reported as describing public internet data as “freeware.” Reddit took the opposite commercial position: public accessibility does not automatically remove the need for permission, compensation or attribution.

Rank #4
15.6 Inch Laptop Computer, N4020, 4GB DDR4 RAM, 128GB eMMC,with Windows 11
  • EFFORTLESS EVERYDAY PERFORMANCE: Powered by Intel Celeron N4020 processor and Windows 11 Home system, delivering reliable, low-power efficiency for daily tasks like document editing, email, online classes, and web browsing
  • 15.6-INCH FULL HD DISPLAY: Enjoy immersive visuals on the 15.6" FHD (1920x1080) anti-glare screen with micro-edge bezels. Delivers clear details and comfortable viewing for long study sessions, working on spreadsheets, and video playback
  • RESPONSIVE MULTITASKING & STORAGE: Built with 4GB LPDDR4 RAM and 128GB eMMC storage for smooth daily essential use. Expand your storage by up to 1TB via the integrated TF card slot to easily store movies, photos, and working files
  • ADVANCED CONNECTIVITY: Outfitted with 2x Full-Featured Type-C ports for data transfer, fast charging, and dual-monitor output, alongside 2x USB 3.2 Gen1 ports and a 3.5mm audio jack for complete peripheral compatibility
  • LIGHTWEIGHT & SILENT OPERATION: Slim and portable for effortless travel or commuting. Features a 1MP HD webcam for remote meetings, 38Wh battery with 45W Type-C fast charging, and a fanless silent design for peaceful work environments.

The legal answer can vary with copyright, contracts and terms of service, privacy rules, database rights, jurisdiction and the exact technical use. Robots.txt alone does not make scraping illegal, and a public URL alone does not establish unrestricted permission for every downstream use.

What users noticed

For people searching in Bing, newer Reddit answers became less reliable or disappeared. That particularly affected current troubleshooting threads, niche communities and discussions that had not existed when Bing’s older index was built. Google remained the more dependable route in the immediate aftermath.

The trade-off is broader than convenience. Blocking crawlers can create licensing revenue and give Reddit more control over training, summaries, retention and attribution. It can also reduce referral traffic, weaken discovery of smaller communities and push users toward the largest licensed search partner. Bing Webmaster Tools can help publishers manage Microsoft’s crawler, but it cannot control every AI crawler, API, cache or third-party dataset.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

What Reddit’s current API terms say

Reddit’s Data API terms, revised July 20, 2026, show that the controlled-access approach continued after the 2024 confrontation. The terms say:

Best Value
Windows 11 Laptop with i3 Processor 15.6" Work Laptop for College Students
  • 【Efficient Performance】 Powered by Intel Core i3 processor (2 cores, 4 threads, up to 3.4GHz) with 12GB RAM and 256GB SSD. Handles multitasking, office software, online classes, and HD video streaming smoothly. Integrated Intel UHD Graphics 620
  • Backlit Keyboard & Complete Package】Comes with a cool backlit keyboard. Comes with awebcam, dual stereo speakers (8Ω/1.0W each), DC charger, and user manual – ready for late-night studying, online classes, video conferencing, and daily productivity
  • 【Vibrant Display】 15.6-inch Full HD (1920x1080) anti-glare screen with 16:9 aspect ratio delivers crisp images and vivid colors – perfect for studying, watching lectures, or entertainment. Thin-bezel design maximizes viewing area
  • 【Fast Connectivity & Expansion】 Equipped with WiFi 6 (802.11ax) and Bluetooth 5.2 for stable, high-speed wireless. Features 3 x USB 3.0, HDMI 2.1, Type-C (supports PD3.0 fast charging), and a TF card slot expandable up to 2TB – easily connect external monitors, mice, drives, or expand storage for all your files
  • 【Long Battery Life & Portable】 Built-in 11.55V 5000mAh/57.75Wh high-capacity battery delivers approximately 7 hours of mixed-use battery life – enough for a full day of classes and assignments. Lightweight at just 1.63kg (3.6 lbs) and 19.5mm thin, plus a compact packing size – easily slips into a backpack for campus, library, or coffee shop
  • API access is a revocable license;
  • Reddit may charge fees in the future;
  • commercial use, research beyond rate limits or uses not expressly permitted may require a separate agreement; and
  • User Content may not be used to train an AI or machine-learning model without express permission from applicable rights holders.

The same terms say User Content remains owned by users. It is therefore inaccurate to say Reddit owns every post or that a Reddit-wide license automatically resolves every individual creator’s rights.

What remains unresolved

The available reporting does not establish whether Microsoft used Reddit data in every way Huffman alleged, whether the companies later negotiated a deal, whether a settlement or lawsuit occurred, or whether a later agreement changed Bing’s access. Microsoft may also have encountered Reddit-derived information through existing indexes, licensed sources, caches or other channels; blocking direct crawling does not erase all historical data.

The lasting significance is the business model. Reddit’s dispute was an early, visible example of publishers moving from “crawl us and send traffic” toward “license our discussions if they become part of your search or AI product.” The same question now confronts forums, news sites and other services built on user-generated content: who controls public web data, and who gets paid when it is turned into a commercial answer?

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Quick Recap

Bestseller No. 1
Bestseller No. 2
Dell Latitude 5420 14' FHD Business Laptop Computer, Intel Quad-Core i5-1145G7, 16GB DDR4 RAM, 256GB SSD, Camera, HDMI, Windows 11 Pro (Renewed)
Dell Latitude 5420 14" FHD Business Laptop Computer, Intel Quad-Core i5-1145G7, 16GB DDR4 RAM, 256GB SSD, Camera, HDMI, Windows 11 Pro (Renewed)
256 GB SSD of storage.; Multitasking is easy with 16GB of RAM; Equipped with a blazing fast Core i5 2.00 GHz processor.
$309.00
Bestseller No. 3
HP 14' HD Laptop, Windows 11, Intel Celeron Dual-Core Processor Up to 2.60GHz, 4GB RAM, 64GB SSD, Webcam, Dale Pink (Renewed)
HP 14" HD Laptop, Windows 11, Intel Celeron Dual-Core Processor Up to 2.60GHz, 4GB RAM, 64GB SSD, Webcam, Dale Pink (Renewed)
14" diagonal, 1366x768 resolution, HD BrightView LED, Glossy NON-TOUCH Display
$249.99

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.