NEW
State of the Bots - Q1 & Q2 2026
TollBit State of the Bots - Q1 & Q2 2026
Products
Solutions
Resources
Marketplace
About
Get started
Products
Licensed RAG access
Bot & agent paywall
Content controls
Agent Site
MCP
NLWeb
Portfolio analytics
TollBit Analytics
Solutions
Digital Publishers
Agentic commerce
Resources
Platform Docs
API & Integrations Docs
Scraper Index
Bot Index
State of the Bots Q2 2025
State of the Bots Q1 2025
State of the Bots Q4 2024
Marketplace
AI companies
About
Press
FAQ
Blog
Team
2026 Q1 & Q2, The Bad Bots
Resource Center
Overview & platform docs
API Documentation
Agent Site white paper
State of the Bots Reports
2026 Q1 & Q2, The Bad Bots
2025 Q3 & Q4, The Leaky Pipes
2025 Q2, Good Net Citizens
2025 Q1, The Rise of RAG Bots
2024 Q4, The First Issue
Foreword
Executive Summary
Section 1: The Scraper Ecosystem & Proxy Networks
Section 2: The Scale of AI Scraping
Section 3: Referral Traffic
Section 4: Robots.txt and the Bypassing Problem
State of the Bots
2026 Q1 & Q2, The Bad Bots