Cloudflare, which spent the past year introducing tools to help content providers prevent unwanted AI scraping, is launching a marketplace that lets websites charge for the privilege of using a “pay-per-crawl” model. The Internet infrastructure and security company says it is the first to enable blocking AI crawlers by default, providing access only with permission and, if wanted, compensation. As of July 1, AI companies can use Cloudflare’s marketplace to “clearly state their purpose — if their crawlers are used for training, inference, or search — to help website owners decide which crawlers to allow.” Continue reading Cloudflare Pay-per-Crawl Lets Publishers Monetize Scrapes