Cloudflare's new AI traffic options for customers

Cloudflare is introducing more granular control options for website owners to manage different types of AI traffic, moving beyond simple blocking to address specific use cases. Rather than categorizing bots as simply "AI" or not, the company is implementing a pragmatic taxonomy that distinguishes between Search (content indexing for later queries), Agent (real-time automated actions), and other behaviors, allowing site owners to permit certain activities while protecting their content and ensuring fair compensation. This shift reflects growing demand for nuanced solutions that balance content protection with discoverability and fair value exchange.