Why crawl Is Trending Today?

Explore key developments that caused crawl to trend — updated as the story unfolds.

2 key events detected

July 2, 2025 at 2:36 PM

Cloudflare introduces a default block on AI crawlers and launches a 'Pay Per Crawl' initiative, allowing publishers to monetize AI bot access to their websites.

July 1, 2025 at 2:16 PM

Cloudflare introduces 'Pay per Crawl', blocking AI bots by default and charging them for website access.