Key Takeaways:
- 1. Cloudflare will now block AI bots by default from accessing websites it hosts.
- 2. Clients can manually allow or ban AI bots on a case-by-case basis and use a “pay-per-crawl” service for compensation.
- 3. Cloudflare’s new measures aim to give website owners more control over how their content is used and credited.
Cloudflare has announced a default ban on AI bots accessing websites it hosts, offering clients the ability to selectively permit or prohibit them and introducing a pay-per-crawl service for compensation. This move addresses concerns about monetization and attribution for data used by AI systems. By allowing website owners more control over crawling activities, Cloudflare aims to facilitate fairer relationships between AI companies and content producers.
Insight: Cloudflare's actions seek to balance the interests of website owners, AI companies, and content creators in the evolving landscape of web crawling and data usage for AI systems.
This article was curated by memoment.jp from the feed source: MIT Technology Review.
Read the original article here: https://www.technologyreview.com/2025/07/01/1119498/cloudflare-will-now-by-default-block-ai-bots-from-crawling-its-clients-websites/
© All rights belong to the original publisher.
