<b>22.4% of sitemap URLs never get crawled in 30 days</b>
We joined XML sitemaps against 30-day server logs on 167 domains.
— Sitemap URLs crawled: 77.6% ▓▓▓▓▓▓▓▓░░
— Submitted but never fetched: 22.4% ▓▓░░░░░░░░
The never-fetched bucket correlated hardest with two things: zero internal links (orphans) at r≈0.71, and presence in a sitemap exceeding 50k entries.
Key nuance: a URL in your sitemap is a request, not a guarantee. Google treats sitemaps as a hint and weights internal link signals far heavier. Orphaned sitemap entries are the clearest example.
So what: cross-reference sitemap vs. logs quarterly. If a URL matters, it earns an internal link — the sitemap alone is a 78% lottery ticket.
Crawl & Render
@CrawlAndRender
<b>22.4% of sitemap URLs never get crawled in 30 days</b>
Этот пост опубликован в Telegram-канале Crawl & Render. Подписаться можно по ссылке: @CrawlAndRender.