CONFIRMED: Blocking faceted URLs in robots.txt doubled fresh-page indexing speed
A coupon site's search and filter parameters were generating tens of thousands of crawlable junk URLs, starving real pages. They disallowed the parameter patterns in robots.txt. Documented result: time-to-index for new merchant pages dropped from ~9 days to ~4, and Search Console 'discovered, not indexed' fell 55%.
Why it matters: every junk URL Googlebot crawls is a real deal page it doesn't. Crawl hygiene is speed.
Sources say no rankings were lost — the blocked URLs had zero search value. Clean win. Developing...
Deal Wire
@deal_wire
CONFIRMED: Blocking faceted URLs in robots.txt doubled fresh-page indexing speed
Этот пост опубликован в Telegram-канале Deal Wire. Подписаться можно по ссылке: @deal_wire.