NEWTollBit State of the AI Bots - Q2 2025
Portfolio analytics

AI bot insights across your entire portfolio, in one centralized dashboard

Portfolio analytics gives publishers and site owners a unified & standardized, portfolio-level view of how AI bots access, scrape, and refer traffic across all of their sites on TollBit.

Problem

Without portfolio-level AI bot analytics, publishers are unable to see where AI demand concentrates, how it changes over time, or which properties drive the most value.

Benefits

Complete picture of AI bot visits on your sites

View aggregated scraping metrics (total scrapes, referral data, individual bot data) across your entire portfolio to clearly demonstrate AI activity to internal stakeholders

Understand bot behavior

Monitor allowed vs. forwarded scrapes and paywall attempts across your portfolio of sites so you can make informed decisions about bot access and rate policies

Prioritize where to focus

If a majority of scrapes come from a small number of properties, that's a signal. It shows which of your sites and pieces of content are most valuable to AI companies

Enable more informed strategy

Publisher teams can now make decisions with portfolio-level data through this aggregate view of how AI interacts with their content, not just individual sites

Insights available in portfolio analytics

Properties view — identify where your scrapes and referrals happen

The properties view provides users with an overview breakdown per site. Identify which properties drive the bulk of AI demand across your network.

TollBit subdomains view — where redirects and bot paywall interactions happen

If you are redirecting traffic to the TollBit Bot Paywall, the subdomain view shows which TollBit subdomains are serving the most forwarded AI bots — and how that activity is changing over time

AI platform view — who is scraping, and who is referring traffic

Break down scraping activity at the platform level (Perplexity, OpenAI, Anthropic, Google, and more). See how often each platform scrapes, what % of your total scrapes each platform is, and their referral rates.

AI bots view — understand the activity from each individual bot across your portfolio

The AI Bots view shows how individual AI bots access your content across your entire portfolio. Compare allowed vs forwarded scrapes and understand which types of bots (retrieval vs training) drive activity. Drill into bot-level metrics including scrape volume, access type, trends, and share of total activity.

Pages view — see which individual pages drive the most AI scrapes

The Pages view drills down to the URL level, showing which specific pages across all of your sites are most frequently scraped by AI bots. This includes page-level scrape volume, directionality trends, and the percentage of total portfolio scrapes that each page represents. Here you can quickly see where AI demand is concentrated.

Built for the ways AI actually interacts with the web

TollBit supports multiple AI use cases with purpose built solutions that are tailored to how agents interact with content and commerce

Digital publishers

Monitor, control, and monetize AI access. Publishers face growing AI traffic that is difficult to track and even more difficult to control. TollBit gives publishers a free platform for understanding how agents interact with their sites, separating AI traffic from human traffic, and enforcing rules and rates for content access.

Agentic commerce

Enable reliable, measurable agent-driven actions. Commerce platforms use TollBit to separate agent access from the human site, require agent identity, expose machine-facing workflows, measure real usage, and attach economics to agent activity, without disrupting existing commerce infrastructure.

Trusted by world's best publishers

Portfolio-level visibility starts here

Track AI bot behavior and trends across all of your properties
TollBit