ShadowX sitemap inventory reconciliation

Create three inventories

List generated public pages, sitemap locations and crawlable internal links. Normalize trailing slashes and compare final HTTPS addresses.

A page should not disappear merely because two inventories use different URL formatting.

Remove noncanonical entries

Exclude redirects, admin pages, error pages, parameters and retired paths. Keep only successful pages that declare themselves canonical.

A sitemap is a canonical inventory, not a record of every URL ever created.

Find missing public pages

Flag an indexable guide that is absent from the sitemap or unreachable through useful navigation. Add it only after its metadata and status are correct.

Policy pages may be included when they are public, canonical and useful to visitors.

Tie lastmod to evidence

Use the last substantive content date for each entry. After deployment, fetch representative pages and submit the sitemap in Bing Webmaster Tools.

Automated builds should fail when the inventory count or canonical mapping changes unexpectedly.

Frequently asked questions