Site SEO & AI Crawler Audit

Audit SEO, redirects, crawlers. People also call this Site Check, Site SEO Check, AI Crawler Access Check, Redirect Chain Checker. The tool names below are unchanged, so an existing client keeps working.

Check one page for an SEO audit, Open Graph tags, a 301 redirect and broken links. Ask "can AI crawlers read example.com?", "is this product page set up for search?", "will AI assistants cite this page?", "can AI shopping agents read this store?", "are any pages in this store's sitemap broken?" or "what would make this landing page convert better?".

Site SEO and AI Crawler Audit fetches public pages and files and reports what it finds. People also call it Site Check. For AI crawler access it evaluates robots.txt for fourteen published AI crawler names against the page path, shows the rule that decided each one, and adds the X-Robots-Tag header and the robots meta tag of the page. For page tags it reads the title, description, canonical link, language and icons, plus the Open Graph social preview tags and Twitter share tags, and lists the common ones that are missing. For redirects it follows the 301 redirect chain hop by hop and shows each status code, the final address and the main response headers.

For online stores and content pages, one product page can be checked for its title and description length, h1 heading, canonical link and Product structured data (name, brand, SKU, GTIN, MPN, price, currency, availability, variants). One domain can be checked for llms.txt, agents.md, the Universal Commerce Protocol file that Shopify stores publish, the sitemap and AI crawler rules in robots.txt. When a page address is checked, it evaluates five content qualities associated with AI search citations: a clear summary near the top, author name and credentials, Q&A or FAQ format, clear heading structure, and structured data, each with pass, warn or fail, evidence and a concrete fix. A sample of up to 40 addresses from the sitemap can be checked for broken pages and redirects. These work on any public site and add Shopify-specific fields where the store is on Shopify. They are not a speed test.

For landing pages, one page can be checked for the items a conversion review (CRO) looks at, each with the evidence found and a fix: one clear h1 and a supporting sentence under it, a primary call to action that is near the top and repeated, whether the call-to-action links work, the number of form fields, trust signals (testimonials, customer logos, review markup, guarantees), a visible price or next step, the mobile viewport tag, HTML size and render-blocking hints, and a way to contact the business. The checklist topics follow the conversion-rate-optimization skill in coreyhaines31/marketingskills (MIT licence); the checks and wording are our own. Contact details, review text and page copy are not returned, only counts and the headline. A sitemap sample can show a broken link or a 404.

Only public websites on the standard web ports are checked. Private, local and internal addresses, other schemes such as file or ftp, and redirects into any of those are refused, and pages are fetched with a User-Agent that names Agent Tools. The store checks read robots.txt first and do not request a page that it disallows for Agent Tools. A check makes a handful of requests, and the sitemap sample or the landing page check at most 46.

It shows what the site publishes to a request from Agent Tools servers right now. It does not test whether a firewall or bot filter blocks real crawlers, does not run JavaScript, does not return page text, does not sign in to anything and does not scan for security vulnerabilities. robots.txt is a request that crawlers follow by choice, not access control.

It stores nothing about you or the site, and no fetched page is kept: answers are cached for five minutes, and the only lasting record is a daily count of calls per tool.

Tools

• check_ai_crawler_access: Check AI crawler access in robots.txt
• check_page_tags: Check Open Graph and share tags
• trace_redirects: Trace a 301 redirect chain
• product_page_seo: Check product JSON-LD and page SEO
• ai_readiness_check: Check AI readiness of a store or page
• link_sample_check: Check a sitemap sample for broken links
• landing_page_check: Check a landing page for conversion

This is a one-page SEO check and a landing-page conversion review. It is not the 25-page SEO Audit crawl, and it does not measure rankings.

The server is https://sitecheck.openkrill.app/mcp and needs no key. Install steps: ChatGPT, Claude, Cursor, Pi.