Patreon has stopped relying on robots.txt requests and begun actively blocking AI training bots through a partnership with Cloudflare, after finding that scrapers were ignoring the platform's instructions entirely.
Patreon, the membership platform for independent creators, has moved beyond passive deterrents and begun actively blocking artificial intelligence bots that scrape content for model training, the company announced Thursday.
The platform is working with internet infrastructure provider Cloudflare to deploy its AI Crawl Control technology, replacing a previous approach that relied on robots.txt files — standard instructions websites use to signal to crawlers how they may interact with a site's content.
The shift reflects a core problem Patreon found with the honor-system approach: AI scrapers were ignoring the instructions entirely. When Patreon tested Cloudflare's blocking tools, weekly access attempts from individual AI training crawlers dropped from "thousands of attempts to zero," according to a company blog post.
"Consent shouldn't depend on whether a scraper chooses to behave," the post stated.
Patreon first put measures in place to deter AI crawlers in 2023, but the company says scraping has grown more sophisticated since then. The problem was compounded by Patreon's own product expansion: the platform recently introduced new discovery features, including a redesigned Home Feed and a tweet-like feature called Quips, which it acknowledges could expose more creator content to automated crawlers.
Drew Rowny, Patreon's product chief, framed the decision around creator autonomy. "As AI agents become increasingly powerful and popular, creators deserve a meaningful say in how their work is used by AI companies," Rowny said in the announcement. "On most of the Internet, creators have to accept AI training on their work just to reach and grow an audience. Patreon has a different vision: creators should be able to grow their audience and control how their work is used."
The company said it will continue to allow bots that index pages and organize information for the purpose of directing users back to Patreon, drawing a distinction between crawlers that serve discovery and those that extract content to train AI models.
Cloudflare has been expanding its suite of tools for publishers navigating AI scraping. Earlier this month, the company updated its policies so that "mixed-use" crawlers — those that both index and train on a site's content — are blocked by default on pages that carry advertising. Cloudflare also operates a marketplace called Pay Per Crawl, which allows websites to charge AI bots for access to their content rather than block them outright.
Patreon's move comes amid a broader industry reckoning over how AI companies obtain training data. Online publishers and individual creators alike have grown increasingly resistant to their work being ingested without consent or compensation, fueling a wave of litigation, policy discussions, and platform-level enforcement changes across the web.
The platform's paywall has historically shielded much of its content from crawlers, but the new enforcement layer signals that passive structural barriers are no longer considered sufficient as AI systems grow more capable of circumventing conventional protections. Whether Patreon's approach — built on Cloudflare's infrastructure — will prompt similar moves from other creator-economy platforms remains a question for the months ahead.
Marc Sabatini is a staff writer at TechEchelon covering enterprise software, cybersecurity, and the regulatory beats that shape both. He focuses on the deal flow and policy decisions that move markets.
More from Marc →Amazon-owned Zoox has voluntarily recalled software in 105 robotaxis after one of its vehicles failed to detect heavy smoke and drove into an active fire scene in Las Vegas on June 20, drawing renewed federal scrutiny of the autonomous vehicle industry.
Anthropic is scheduling meetings with investors ahead of a potential IPO this year, with Goldman Sachs, Morgan Stanley, and JPMorgan Chase involved in planning. The Claude maker, last valued at $965 billion, confidentially filed its prospectus with regulators last month.
Bengaluru-based vibe-coding startup Emergent AI raised $300 million at a $1.5 billion valuation on Wednesday, becoming India's second AI unicorn in a month and underscoring the country's growing ambitions in the global AI race.
Written for readers who already know the basics — markets, AI, and the policy decisions that shape both.