Free survey
Starting surveyrobots.txt, then XML sitemaps, then a live page sample. Typical scans finish in 8–40 seconds.
Warning
The <url> entry has no <lastmod>.
lastmod is optional, but a reliable lastmod helps crawlers prioritize recrawls. Fake lastmod values are worse than missing ones.
<url><loc>https://example.com/post</loc></url>
Each sitemap entry is checked for a lastmod value.
Inspect the raw sitemap XML around the loc.
Emit a real lastmod from the content’s modified time. Do not stamp every URL with the same deploy clock unless that is truthful.
Sitemapper