Skip to the content
Agent Tools

Site SEO & AI Crawler Audit

See which AI crawlers a site lets in, missing share tags and redirects.

Price
Free
API key
None
Limit
60 calls a minute
Tools
9

Try it live

63 calls a week

Which AI crawlers your robots.txt lets in.

check_ai_crawler_access

Ask your assistant
Does this site let AI crawlers in?

What it does

  • Shows whether robots.txt allows or blocks 14 published AI crawlers
  • Shows the rule that decided each crawler, the sitemaps and any noindex or noai directives
  • Reads a page's title, description, canonical link, language and icons
  • Reads Open Graph and Twitter share tags and lists the common ones that are missing
  • Follows the redirect chain with each status code and shows the final address and headers
  • Checks one product page's title, description, h1, canonical link and Product structured data (price, GTIN, availability)

11 more in the full text.

Tools

  • check_ai_crawler_accessCheck AI crawler access in robots.txt
  • check_page_tagsCheck Open Graph and share tags
  • trace_redirectsTrace a 301 redirect chain
  • product_page_seoCheck product JSON-LD and page SEO
  • ai_readiness_checkCheck AI readiness of a store or page
  • link_sample_checkCheck a sitemap sample for broken links
  • landing_page_checkCheck a landing page for conversion
  • exposure_checkCheck the exposed surface of a site you own
  • ai_app_checkCheck an AI-built app for leaks and open data

Connect

https://sitecheck.openkrill.app/mcp

Claude Code:

claude mcp add --transport http site-check https://sitecheck.openkrill.app/mcp

Hermes Agent:

printf 'n\ny\n' | hermes mcp add site-check --url https://sitecheck.openkrill.app/mcp

Go further

Full text for agents: site-check.md, llms.txt. Version 1.8.0, 2026-10-18.