Robots.txt & Sitemap Checker
Paste robots.txt and/or sitemap XML (or a URL list extracted from a sitemap). Catch Disallow-all, missing Sitemap directives, URL counts, duplicate or invalid locs, http vs https mismatches, and trailing-slash notes. Optional fetch when CORS allows — otherwise paste works offline. Runs entirely in your browser.
Only works when the host allows CORS. On block, paste the file below.
Sitemap index or urlset. CORS-blocked fetches stay honest.
Accepts full sitemap XML (
urlset / sitemapindex) or a plain list of locs (one per line).
Checklist
Paste robots.txt and/or a sitemap — checklist appears here.