What is llms.txt and why does it matter?

llms.txt is a proposed standard file at your site root that tells AI crawlers and assistants what your site contains and how it may be used. A valid llms.txt improves the odds that ChatGPT, Perplexity, and Google AI Overviews can find, understand, and cite your content accurately.

Which AI crawlers does the checker audit?

The checker validates your llms.txt syntax and audits robots.txt rules for major AI crawlers including GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, Google-Extended, and CCBot. It also checks AI-readable metadata like structured data and meta descriptions.

Does allowing AI crawlers hurt my SEO?

Allowing AI crawlers does not directly change your Google rankings, but it controls whether AI assistants can cite your brand. Blocking everything means competitors' content gets cited instead of yours. The checker shows exactly what each crawler is allowed to access so you can decide deliberately.

Free tool · No signup

Free AI crawler checker

Check if AI assistants can find and cite your site: validate your llms.txt, audit which AI crawlers (GPTBot, Perplexity, Claude) your robots.txt allows or blocks, and verify AI-readable metadata — with an instant grade.

Want deeper AI visibility scoring across ChatGPT, Perplexity and Google AI? Run a GEO audit →