Study 1
We put llms.txt on 83 websites. In 12 weeks, OpenAI's crawler read it 7 times.
83 sites, 12 weeks of server logs: OpenAI read llms.txt 7 times, Anthropic 9, Perplexity 0 - while fetching robots.txt thousands of times.
Read the studyEZY Research · July 2026
EZY Research - AI Traffic Studies
Four studies from EZY.ai's 556-domain research panel: server-side logs from 125 connected (opt-in cohort) business websites and pre-optimization audits of 387 more. Every number below comes from a query run on production data. Published 27 July 2026.
7
OpenAI llms.txt fetches
vs 3,990 robots.txt fetches
3.8x
Usage vs training
live user fetches per training crawl
1.8x
AI vs Googlebot
763k AI crawls vs 444k Googlebot
69%
No AI instructions
of 387 never-optimized sites
The studies
Study 2
For every training crawl OpenAI makes, real ChatGPT users trigger four live visits
Server logs from 125 business sites: ChatGPT-User made 147,830 live fetches vs GPTBot's 39,042 training crawls. AI traffic is 4:1 usage over training.
Read the studyStudy 3
AI crawlers now hit small-business websites 1.8x as often as Googlebot
12 weeks, 125 sites: AI crawlers hit business websites 1.8x as often as Googlebot, yet send under 1% of visitors. The EZY AI Traffic Index, issue 1.
Read the studyStudy 4
Seven in ten business websites have never told AI crawlers anything at all
We audited 387 business websites before optimization: 69% give AI crawlers no instructions, 12.7% block GPTBot, 52% lack llms.txt.
Read the studyAbout this panel
Server-side request logs with user-agent classification and signature verification. Pre-intervention site audits for the readiness benchmark. Temporal coverage 27 Apr-19 Jul 2026. Aggregate CSVs available on request under CC BY 4.0. See also our FAQ.