Cloudflare blocks AI agents by default now, and your agent can't tell
- My agent was confidently wrongAs of July 1, 2025, Cloudflare blocks AI crawlers by default on every new domain, and it has since turned away hundreds of billions of bot requests.
- Most of the coverage was about the big fight, AI labs against publishers over training data.
- My problem was an agent that kept coming back confidently wrong.
Unverified
- My agent was confidently wrongAs of July 1, 2025, Cloudflare blocks AI crawlers by default on every new domain, and it has since turned away hundreds of billions of bot requests.
- Most of the coverage was about the big fight, AI labs against publishers over training data.
- My problem was an agent that kept coming back confidently wrong.
Sources: Tilion