How much web traffic is AI bots?
On the median North American website, AI bots made 1 visit for every 93 human visits in the first half of 2026, and 1 for every 33 in Europe (TollBit State of the Bots H1 2026). Across the whole web, counting every kind of automated request, Cloudflare's CEO said in May 2026 that bots had passed humans at about 60% of requests. The first number is identified AI agents on ordinary sites. The second is all automation everywhere.
Figures as of October 15 2026. Refreshed with each State of the Bots.
The numbers
| Measure | Figure | Source and period |
|---|---|---|
| Website visits analyzed | 987B+ | TollBit State of the Bots, H1 2026 |
| AI bot scrapes detected | 22B+ | TollBit, H1 2026 |
| Scrapes that ignored robots.txt | 1.9B+ | TollBit, H1 2026 |
| AI bots directed to the TollBit Bot Paywall | 2.6B+ | TollBit, H1 2026 |
| AI bot visits per human visit, median North American site | 1 per 93 | TollBit, H1 2026 |
| AI bot visits per human visit, median European site | 1 per 33 | TollBit, H1 2026 |
| EU scrape-to-referral ratio | 150:1 (Q1) to 227:1 (Q2) | TollBit, 2026 |
| robots.txt ignored, EU vs North America | 2.8x more often in the EU | TollBit, H1 2026 |
| Claude-User traffic that was spoofed | 12.7% | TollBit, H1 2026 |
| AI bot fetches observed across 10,000+ sites | 200M+ a day | TollBit network logs, 2026 |
| Automated share of all web requests | about 60% | Cloudflare CEO, May 2026 |
| Forecast growth in automated traffic within five years | about 1,000x | Cloudflare CEO, 2026 |
| Reads to referrals on tollbit.com | about 1,000:1 | tollbit.com logs, Sep 15 to Oct 14 2026 |
Reads versus referrals
For every human that AI assistants sent back to a European page in Q2 2026, they read that page 227 times, up from 150 in Q1. On our own site the ratio is about 1,000 to 1: roughly 44K AI crawl attempts and 47 AI referrals in 30 days. Reads are growing. Referrals are a trailing, shrinking metric, because agents increasingly complete the task in place.
Why it keeps growing
- RAG cannot cache the internet. Retrieval loads a page into a context window every time a question is asked, so the same page is re-fetched again and again.
- Agents do not get tired. A person reads one comparison page. An agent asked the same question reads twenty.
- New visitor classes arrive on top. Coding agents, computer-use agents and personal assistants add to crawlers and indexers, not replace them. 28 distinct AI agents read tollbit.com in one month.
- Page analytics shows none of it. Bots do not run JavaScript, so Google Analytics records nothing, and sites that only look there conclude AI traffic is small.
The place to count your own is server logs or your CDN: reads by agent and purpose, reads to referrals, crawl success. TollBit Analytics gives a site that view from the same logs.
Frequently asked questions
Is 60% of all web traffic AI? No. About 60% is automated, per Cloudflare's CEO, and that includes search crawlers, monitoring, scrapers and attack traffic. Identified AI agents on a typical site are a smaller share: 1 visit per 93 human visits in North America, 1 per 33 in Europe.
Why is Europe's ratio three times North America's? European sites see more AI bot visits per human visit, and robots.txt is ignored 2.8 times more often there. More reading, less compliance.
How often are these figures updated? Network figures with each State of the Bots report, each half year. The tollbit.com figures are from a 30-day window ending October 14 2026.