Cloudflare has announced plans to block AI bots and implement a pay-per-crawl model for sites it serves, aiming to compensate publishers for content access. Amanda Martin of Mediavine commends this initiative but questions its long-term viability. Publishers are advised to evaluate their approach to AI scrapers carefully, considering the implications for their revenue and discoverability. Mediavine offers guidance to its network of publishers, emphasizing the importance of responsible AI practices in an evolving digital landscape.
In early July, Cloudflare announced that it would block all AI bots and crawlers by default on the sites it serves and introduce a "pay per crawl" model to remunerate pubs every time an AI company wants to access their content.
Mediavine encourages publishers to carefully consider how they use AI and to prioritize responsible AI practices, advising them on a situational, case-by-case basis.
Amanda Martin applauds Cloudflare for taking a stand but expresses uncertainty about the long-term commercial viability of their approach.
Publishers face challenges as generative AI search reduces content discoverability and traffic, but they must weigh the potential benefits and risks of allowing scrapers.
Collection
[
|
...
]