The CEO of Cloudflare, a leading figure in cybersecurity and services, Matthew Prince, recently pointed out that the Internet has reached a critical historical turning point. According to the latest statistics, automated robot traffic on the Internet has officially surpassed human-generated traffic, becoming the dominant force in web access. Prince acknowledged that this trend is evolving much faster than expected by the industry, with the traffic reversal originally anticipated to occur by the end of 2027 now emerging prematurely due to the influence of various AI agents.

image.png

Agents Drive a Dramatic Shift in Traffic Patterns

According to Cloudflare's global HTTP request data from its monitoring platform, automated access requests initiated by various robots, crawlers, and AI agents now account for 57.4% of the global total, while requests from human users have dropped to 42.6%. Although the data may still be somewhat rough, the trend of automated traffic surpassing human traffic is irreversible. In Prince's view, the future internet ecosystem rules will inevitably undergo a disruptive change, and the era of "pay-to-scrape" will become unavoidable.

To address this change, Cloudflare launched a service platform last summer that allows website owners to block AI crawlers and charge for data scraping activities. However, due to a lack of supporting ecosystems, the project did not gain widespread attention or application in the market previously.

Infrastructure Upgrades for a New Ecosystem

Facing the surge in AI traffic, Cloudflare is currently developing new protocols and underlying infrastructure to support the high-frequency settlements and traffic control required for the future paid scraping exchange. Prince believes that whether they are called robots, crawlers, or agents, they are essentially the same type of automated tool. Website owners need to fundamentally shift their mindset from confrontation to turning it into a new opportunity for monetization.

At the same time, traditional internet giants are accelerating the transition of users toward new AI interaction models. For example, features like AI summaries and AI mode introduced by Google have already attracted billions of users worldwide, further proving that the way users obtain information is rapidly shifting from traditional web browsing to AI summaries.