Cloudflare spent a year blocking AI crawlers. Now it’s helping OpenAI index the web

Cloudflare, which previously helped websites block AI crawlers, is now collaborating with OpenAI in a pilot to use its network data to improve ChatGPT's web indexing and provide fresher search results. This partnership aims to enhance AI search accuracy by feeding real-time web signals into OpenAI's system, addressing content discovery rather than licensing.