Bottom line first: A googlebot sitemap lists URLs for Google to discover, crawl, and potentially index. Keep it limited to canonical, indexable, 200-status pages.
Run this checklist
— List only URLs that return a 200 status and use self-referencing canonical tags.
✅ Exclude redirects, 404s, 410s, blocked pages, and URLs with noindex.
— Include URLs only if they belong in search results; review faceted and parameterized routes.
✅ Exclude internal search results, session URLs, and tracking variants.
— Keep each sitemap file under 50,000 URLs or 50 MB uncompressed.
✅ Split larger inventories into a sitemap index.
— Set lastmod only when the page’s meaningful content changed.
✅ Do not regenerate timestamps on every export.
— Publish the sitemap at a stable URL and reference it in robots.txt.
✅ Verify that the sitemap URL and every listed page are accessible to crawlers.
— Submit the sitemap in Google Search Console and inspect discovered URLs.
✅ Confirm that Google reports no fetch or URL errors.
Common mistakes
— Submitting blocked URLs.
— Mixing canonical pages with duplicate variants.
— Setting priority and changefreq for every URL without a real maintenance rule.
Q: How do I generate a sitemap from URLs?
A: Export canonical, indexable, 200-status URLs into XML, validate the file, then publish and submit it.
The main thing: A googlebot sitemap must contain only crawlable, canonical URLs that you want indexed; every URL must pass the 200-status rule.
The Sitemap SOP
@SitemapSOP
Googlebot sitemap: verify discovery and indexing
This post was published in the Telegram channel The Sitemap SOP. Subscribe here: @SitemapSOP.