Interview
Can Cloudflare make AI companies pay creators?

Stephanie Cohen
Chief Strategy Officer, Cloudflare
28 minHosted by Kim Isenberg
Watch on YouTubeAbout this conversation
AI companies increasingly crawl and use content from the open web, while creators and publishers often receive neither meaningful traffic nor compensation in return. Kim Isenberg speaks with Stephanie Cohen, Chief Strategy Officer at Cloudflare, about the company’s plan to reshape that relationship — from giving website owners more control over AI bots to the shift from Pay Per Crawl to Pay Per Use.
They also discuss Cloudflare’s rules for distinguishing search, training and AI-agent traffic, the relationship between Google Search and AI answers, and the bigger questions: should Cloudflare have the power to decide which bots can access the web, and can the open web survive without a new economic model for original content?
Topics
- How AI crawlers use online content
- Pay Per Crawl versus Pay Per Use
- Getting creators and publishers compensated
- Cloudflare’s AI-bot controls
- Search, training and agent traffic
- Google’s role in the changing web economy
- Whether the open web can survive the AI transition
Chapters
- 0:00AI impact on web content
- 1:12Introduction to the problem
- 2:27Content independence vision
- 3:53Cloudflare's network role
- 4:50The emerging AI economy
- 7:08Input vs. output models
- 8:27Market-based payment systems
- 10:13Reducing crawling waste
- 11:23New default site settings
- 12:39Defining web traffic types
- 14:34Supporting smaller creators
- 16:06Publisher leverage in AI
- 17:38Data and publisher strategy
- 18:46Opportunities for creators
- 21:30Getting started with tools
- 22:20Ethical governance concerns
- 23:39The future of the web
- 25:31Optimistic outlook summary
Kim Isenberg is co-founder and Editor-in-Chief of Superintelligence, an AI newsletter published every weekday.
Read the NewsletterMore interviews
- Alex SalazarWhy AI agents break in production
- Sam StanwyckHow NVIDIA is building quantum computing
- Robby SteinOn AI Mode and the future of links