Budget Myths
Budget Myths
@CrawlBudgetMyths

Your faceted navigation is generating a billion URLs and you let it

Your faceted navigation is generating a billion URLs and you let it

The failure mode: color + size + price + sort + page, all as crawlable links. Five filters with ten values each and you've handed Googlebot 100,000 near-duplicate URLs per category.

This is the one case where crawl budget actually bites mid-size sites. Google burns its crawl on ?color=red&sort=asc&page=7 and never reaches your new products.

The fix is not "add canonical and hope." Canonical doesn't stop the crawl. Use robots.txt to disallow the parameter combinations you never want indexed, and serve filter links as non-crawlable where it makes sense.

Google's John Mueller has said faceted nav is the number-one crawl-budget killer he sees.

Fix the URL space, not the symptoms.
Этот пост опубликован в Telegram-канале Budget Myths. Подписаться можно по ссылке: @CrawlBudgetMyths.
tech

Свежие посты в категории «Tech Infrastructure»

Все каналы категории →

start

Готовы запустить рекламу через сеть public.tg?

Новый оффер, продукт, GEO, кейс, событие или партнёрский запуск — соберём маршрут под задачу и отдадим медиаплан.

Telegram для медиаплана: @AFFtop_connect. Быстрый тест: $20 за канал, $1000 за пакет по сети.