#ai-bots

#ai-bots

On July 1, Cloudflare, which powers about 20% of global web traffic, rolled out a bold new stance: default blocking of AI bots like OpenAI's GPTBot and Anthropic's Claude unless sites explicitly allow or monetize access.

Programmatic buyers should adapt to modern media buying challenges as they now navigate an expansive landscape filled with unexpected ad placements across millions of channels.

From Q4 2024 to Q1 2025, bot scrapes used for Retrieval Augmented Generation, or RAG, per site grew 49%. That is nearly 2.5 times the rate of training bot scrapes.

It starts with publishers, but this is coming for everyone,.... With tools like ChatGPT becoming a first-stop search engine for millions, optimizing for human readers may no longer be enough.