AI Crawler Analytics: See Which Pages ChatGPT, Claude, Perplexity and Gemini Read on Your Site
EZY.ai's AI Crawler Analytics records every visit from the ChatGPT, Claude, Perplexity and Gemini crawlers to your website. It reports at page level, updates daily, and separates bot traffic from human traffic. It's included in the free Starter plan, so you can see which pages AI systems fetch and which they skip.
How do I see which AI crawlers visit my website?
You connect EZY.ai to your site through WordPress, Cloudflare, or a script tag, and the dashboard logs each ChatGPT, Claude, Perplexity and Gemini crawl by page and by day. Bot visits and human visits appear separately, so you can read AI attention on its own.
Setup takes one of three routes, all included in the Starter plan:
- WordPress: install the integration and the tracking and generated files go live from your existing site.
- Cloudflare: connect through your Cloudflare account if your domain already runs there.
- Script tag: add a single tag to any site that uses neither WordPress nor Cloudflare.
Starter costs $0. Our pricing page lists everything included, and you can cancel any paid subscription anytime, with access continuing until the end of the billing period.
What AI crawler data tells you
AI Crawler Analytics shows you three things: which pages AI crawlers fetch, which they never touch, and how that pattern moves from day to day. Each one points to a different action.
| Signal in your data | What it means | What to do |
|---|---|---|
| Key service page crawled daily | AI crawlers can reach and fetch the page | Move on to prompt tracking to see if it gets cited |
| Key page with zero AI crawls | The crawlers haven't fetched that page | Check robots.txt, sitemap and internal links |
| Crawls on old or thin pages only | Crawler attention sits on low-value URLs | Point internal links and llms.txt at your best pages |
| Human visits arriving after AI crawls | Visitors may be coming from AI answers | Track prompts to confirm the source |
Bot-versus-human separation matters because a raw traffic total mixes the two. A page with a spike in visits could be getting a spike in crawler fetches, a spike in people, or both, and the two call for different responses.
Why crawl data and your AI files belong together
The files AI crawlers read and the analytics that show them being read live in the same product, which means you can change a file and watch the result.
The Starter plan generates and publishes three of those files:
- robots.txt, which tells crawlers what they may fetch.
- llms.txt, a plain-language map of your site written for language models.
- An XML sitemap, which lists every page you want discovered.
Our post on the fact file explains why we treat verified business facts as the foundation for everything else.
Here's a typical sequence. A local trades business publishes its robots.txt and llms.txt from Starter, then watches the page-level crawl log for the next several days. If the "emergency repairs" service page shows no Claude or Perplexity visits while the homepage gets plenty, the owner knows where to look first: that page's internal links and its listing in the sitemap.
What should I do when a key page gets no AI crawler visits?
Check four things in order: whether robots.txt allows the AI crawlers, whether the sitemap lists the page, whether other pages link to it, and whether llms.txt mentions it. Fix the first gap you find, then watch the daily crawl log for the page to appear.
Take each check in turn:
- robots.txt. Confirm that no rule blocks the ChatGPT, Claude, Perplexity or Gemini crawlers from the page's folder. Our robots.txt generation and auditing covers this.
- XML sitemap. The page's URL needs an entry. A generated sitemap includes it automatically once the page is live.
- Internal links. A page linked from your homepage and related pages gives a crawler a clear path to it.
- llms.txt. List the page with a one-line description of what it answers.
On the Growth plan, 1-Click Fix All identifies AEO issues and applies the available fixes in one step, and Answer Pages and FAQ hubs join that same workflow.
Crawl visits are the first layer, citations are the second
A crawl visit tells you a page was fetched. Citation tracking tells you whether an AI answer then names your business.
Prompt and Citation Tracking runs buyer-style natural-language prompts across AI engines and records brand mentions, cited sources, and how visibility changes over time. Growth tracks 25 prompts and 15 competitors. Scale tracks 50 prompts and 25 competitors. Our guide to tracking AI prompts and citations walks through that second layer in full.
Used together, the two datasets answer a sharper question. Say a page is crawled every day and still never cited for the prompt it targets. That points to the page's content and structure, and the crawl log has already ruled out access as the cause.
What each EZY.ai plan includes
| Starter | Growth | Scale | |
|---|---|---|---|
| Price | $0 | $49 per month | $99 per month |
| AI Crawler Analytics | Yes, page-level, daily | Yes | Yes |
| robots.txt, llms.txt, XML sitemap | Generated and live | Yes | Yes |
| Answer Pages per month | None | 4 | 8 |
| FAQ hubs per month | None | 1 | 2 |
| Tracked prompts | None | 25 | 50 |
| Tracked competitors | None | 15 | 25 |
| EZY Capture messages | None | 100 per day | Unlimited |
| Support | Community | Priority | Priority |
Yearly billing saves 14% on paid plans. Growth also adds the full AEO file set and one-click publishing. Our About page covers how the platform tracks, optimizes, automates and reports on AI visibility.
If you want a baseline before choosing a plan, the free AI Visibility Score and website audit takes your domain and returns a score out of 100. That score blends your presence, citations, entity coverage and schema coverage in AI answers.
Frequently asked questions
Does AI Crawler Analytics cost anything?
AI Crawler Analytics comes with the Starter plan, which is free. You get page-level, daily reporting on every ChatGPT, Claude, Perplexity and Gemini crawl, with bot traffic separated from human traffic. Starter also includes generated robots.txt, llms.txt and XML sitemap files, integrations for WordPress, Cloudflare and script tag, and community support.
Which AI crawlers does the analytics cover?
The analytics tracks visits from the ChatGPT, Claude, Perplexity and Gemini crawlers. Each visit is recorded against the specific page that was fetched, and the data refreshes daily. You can scan the log for any page on your site and see when an AI crawler last reached it.
Does a crawler visit mean my business will be cited in AI answers?
A crawler visit shows that an AI system fetched your page. Whether your business then appears in an answer depends on how well the page's content, structure and verified facts match the question being asked. Prompt and Citation Tracking, available on Growth and Scale, measures the citation side directly.
What does the free AI Visibility Score measure?
You enter your website domain and receive a score out of 100. The score blends four signals: your presence in AI answers, your citations, your entity coverage, and your schema coverage. The audit also lists the visibility gaps it finds, so you leave with a concrete set of fixes.
Where can I check whether the platform is running normally?
We publish a live system status page showing the health of the database, cache, queue system and API services, along with response times for the last 24 hours. It's the quickest way to confirm that tracking and generation services are operating before you troubleshoot your own setup.
If you'd like help reading your own crawl data, or want to know which plan fits the number of pages and prompts you need to cover, send your site and your question using the form below this article and we'll reply with specifics.
See which of your pages AI systems are reading
We reply fast.
What would you like help with?
How soon?
Cancel anytime.