Interview

Can Cloudflare make AI companies pay creators?

Stephanie Cohen

Chief Strategy Officer, Cloudflare

28 minHosted by Kim Isenberg

Watch on YouTube

About this conversation

AI companies increasingly crawl and use content from the open web, while creators and publishers often receive neither meaningful traffic nor compensation in return. Kim Isenberg speaks with Stephanie Cohen, Chief Strategy Officer at Cloudflare, about the company’s plan to reshape that relationship — from giving website owners more control over AI bots to the shift from Pay Per Crawl to Pay Per Use.

They also discuss Cloudflare’s rules for distinguishing search, training and AI-agent traffic, the relationship between Google Search and AI answers, and the bigger questions: should Cloudflare have the power to decide which bots can access the web, and can the open web survive without a new economic model for original content?

Topics

  • How AI crawlers use online content
  • Pay Per Crawl versus Pay Per Use
  • Getting creators and publishers compensated
  • Cloudflare’s AI-bot controls
  • Search, training and agent traffic
  • Google’s role in the changing web economy
  • Whether the open web can survive the AI transition

Chapters

  1. 0:00AI impact on web content
  2. 1:12Introduction to the problem
  3. 2:27Content independence vision
  4. 3:53Cloudflare's network role
  5. 4:50The emerging AI economy
  6. 7:08Input vs. output models
  7. 8:27Market-based payment systems
  8. 10:13Reducing crawling waste
  9. 11:23New default site settings
  10. 12:39Defining web traffic types
  11. 14:34Supporting smaller creators
  12. 16:06Publisher leverage in AI
  13. 17:38Data and publisher strategy
  14. 18:46Opportunities for creators
  15. 21:30Getting started with tools
  16. 22:20Ethical governance concerns
  17. 23:39The future of the web
  18. 25:31Optimistic outlook summary

Kim Isenberg is co-founder and Editor-in-Chief of Superintelligence, an AI newsletter published every weekday.

Read the Newsletter

More interviews

All interviews