Free survey
Starting surveyrobots.txt, then XML sitemaps, then a live page sample. Typical scans finish in 8–40 seconds.
Critical
A URL is advertised in the sitemap while the page (or header) tells crawlers not to index it.
Sitemaps should list URLs you want discovered. Mixing noindex with sitemap inclusion wastes crawl budget and sends mixed signals.
https://example.com/thank-you is in sitemap.xml and contains <meta name="robots" content="noindex">.
Sitemapper fetches the live page and looks for a robots meta or X-Robots-Tag noindex directive.
Open the URL, view source, and check meta robots plus response headers. Confirm the URL is still in the sitemap.
Remove the URL from the sitemap, or remove noindex if the page should be indexed. Do not leave both.
Sitemapper