Crawl & Render
Crawl & Render
@CrawlAndRender

<b>Median crawl-to-index lag: 4.2 days</b>

<b>Median crawl-to-index lag: 4.2 days</b>
Across 287 mid-size sites (10k-500k URLs) we timed the gap between first Googlebot hit and first appearance in the index.

— p50: 4.2 days
— p90: 19.6 days ▓▓▓▓▓▓▓▓▓░
— Thin/duplicate clusters: 31.0 days, often never

The spread matters more than the median. Sites with a tight p50-p90 band (under 6 days) shared one trait: a flat link graph where new URLs sat ≤3 clicks from a hub. Sites with a 25+ day tail buried new pages 5-7 clicks deep.

So what: don't optimize your average. Hunt the p90 tail — those are the URLs Google crawled, judged marginal, and parked. Pull them up the click-depth ladder before you blame the crawler.
Этот пост опубликован в Telegram-канале Crawl & Render. Подписаться можно по ссылке: @CrawlAndRender.
start

Готовы запустить рекламу через сеть public.tg?

Новый оффер, продукт, GEO, кейс, событие или партнёрский запуск — соберём маршрут под задачу и отдадим медиаплан.

Telegram для медиаплана: @dumay. Быстрый тест: $20 за канал, $1000 за пакет по сети.