See the agency plan →

Crawlability.ai
Blog

You rank on Google. What do the engines say?

Checked findings on how ChatGPT, Gemini, Claude and Perplexity read and cite brands — and what agencies can do about it.

Crawlability
02
AI search
01
For agencies
01
AI search

AI Crawler User Agents: ChatGPT, Claude, Gemini and Perplexity

Every crawler the four AI engines use, what each one actually does, and the robots.txt directives that control them. Checked against each vendor's own docs.

Crawlability Research6 min readOctober 13, 2026
Read the finding

All posts

What to Charge for AI Visibility Reporting

For agencies

Four ways agencies are structuring the price of AI search work, what each one does to your margin, and the mistake that makes the whole line unprofitable.

For agencies5 min read

Crawlability vs Indexability

Crawlability

Crawlable doesn't mean indexed, and indexed doesn't mean cited. The three states a page can be in, how to tell them apart, and what to fix at each one.

Crawlability5 min read

What Is Crawlability?

Crawlability

Crawlability is whether a search engine or AI engine can reach and read your pages. What it means, what blocks it, and why it now matters twice over.

Crawlability5 min read

See how AI engines see your brand.

Measure how ChatGPT, Gemini, Claude and Perplexity find, understand and cite you.

7-day trial with 100 credits · card required · cancel anytime