<b>Median crawl-to-index lag: 4.2 days</b>
Across 287 mid-size sites (10k-500k URLs) we timed the gap between first Googlebot hit and first appearance in the index.
— p50: 4.2 days
— p90: 19.6 days ▓▓▓▓▓▓▓▓▓░
— Thin/duplicate clusters: 31.0 days, often never
The spread matters more than the median. Sites with a tight p50-p90 band (under 6 days) shared one trait: a flat link graph where new URLs sat ≤3 clicks from a hub. Sites with a 25+ day tail buried new pages 5-7 clicks deep.
So what: don't optimize your average. Hunt the p90 tail — those are the URLs Google crawled, judged marginal, and parked. Pull them up the click-depth ladder before you blame the crawler.
Crawl & Render
@CrawlAndRender
<b>Median crawl-to-index lag: 4.2 days</b>
Этот пост опубликован в Telegram-канале Crawl & Render. Подписаться можно по ссылке: @CrawlAndRender.