Cloudflare: Stay discoverable in search while disallowing AI training

Cloudflare has introduced a new "Disallow AI Training" setting that allows website owners to prevent their content from being used for AI training while remaining visible in search results, addressing the previous all-or-nothing tradeoff caused by mixed-use crawlers. Major tech companies including Apple, Google, and Microsoft have committed to honoring this setting. The company also plans to offer granular controls for AI summaries by early next year, recognizing that 17% of Cloudflare sites want to block AI training while less than 1% want to block search indexing.