Bot Traffic Overtakes Human Traffic in 2024 as AI Agents and Scrapers Surge

Analysis of internet traffic from 2013 to 2026 shows automated bots steadily eroding human dominance online. Imperva data reveals human traffic fell to 47 percent by 2025 while malicious bots reached 40 percent. Good bots such as search crawlers remain stable, but gray AI agents and scrapers now drive much of the growth. Companies face rising infrastructure costs from bot traffic that generates no revenue, described as an invisible tax. Cloudflare and Akamai reports confirm high volumes of automated requests, with many classified as harmful scraping. The trend raises concerns about a synthetic internet shaped more by AI recommendations than human activity.

HabrTranslated from Russian

Read at source

The theory of a so-called dead internet has circulated since at least 2014, but recent data shows automated traffic is indeed overtaking human activity. Anti-detect browser company Aurorium examined traffic composition from 2013 onward and concluded that bots now hold a majority share in many segments.

Modern internet traffic consists of human users who create content and drive searches, plus bots divided into good, bad, and gray categories. Good bots include search engine crawlers, uptime monitors, news aggregators, and social media bots. Bad bots range from simple scripts to advanced tools that rotate fingerprints, use proxies, and mimic human mouse movements. Gray bots encompass AI agents and neural crawlers whose long-term value to webmasters remains unclear.

Imperva statistics illustrate the shift. Human traffic stood at 57 percent in 2013, dipped in 2014 due to good-bot indexing, then recovered through 2019 as smartphone adoption and 4G networks brought hundreds of millions of new users from Asia. From 2020 onward, pandemic-driven automation reversed the trend. By 2023 human traffic had fallen to 50.4 percent while malicious bots climbed to 32 percent.

The acceleration continued after generative AI tools lowered the barrier to creating scrapers. In 2024 human traffic dropped below 50 percent for the first time, reaching 49 percent against 51 percent automated. Latest figures show humans at 47 percent and bots at 53 percent, with the majority of bot activity classified as harmful scraping rather than beneficial indexing.

Additional sources align with these findings. Cloudflare reports that automated requests account for 37.5 percent of HTTP traffic, 87 percent of which originates from desktop environments. Akamai analyzed 6.9 billion requests and found 49.3 percent human, 42.1 percent bot-driven, and 65.3 percent of bot traffic tied to malicious scraping.

Within the bad-bot category, gray AI agents represent a fast-growing subset. AI crawlers comprise 85 percent of neural traffic while interactive AI agents account for 15 percent and are expanding at roughly 7 percent per year. These agents already compare prices, read documentation, and complete bookings with minimal human input.

Businesses bear an infrastructure tax from this traffic. A site that once handled 200 daily visitors may now serve 5,000, forcing upgrades to costlier hosting plans even though a large share of requests come from non-converting bots. For a digital property with 100 million monthly views and 30 percent bot traffic, annual server costs attributable to automation can exceed $19,000, excluding expenses for CAPTCHA services.

Site owners face difficult choices about blocking AI crawlers. Aggressive filtering risks losing legitimate mobile users sharing the same carrier-grade NAT addresses. At the same time, media organizations such as BBC and CNN that strictly limit AI access still achieve high citation rates in neural search results, suggesting that voluntary openness may not be required for visibility.

The cumulative data lends increasing weight to the dead-internet hypothesis. Human users are becoming a minority in the network they created, and recommendation systems trained on bot-generated patterns risk producing an increasingly synthetic information environment with no clear reversal in sight.

Meridian digestThe week's most consequential security stories, distilled into one briefing.See the digest

More in Other

Mail.ru Reduces Lifetime 1TB Cloud Storage Promo to Standard 8GB Quota for Select Users
Kimi K3 Open Model Surpasses Closed AI Leaders with Million-Token Context and 896 Experts
Innostage Completes Functional Testing of PT NGFW 1.10.3 Across 156 Criteria