The real crawl waste is your faceted navigation, not your blog
Everyone audits article URLs for crawl waste. Meanwhile the actual hemorrhage is the filter and sort combinatorics nobody opens in the logs.
Color + size + price + sort + page generates millions of near-identical URLs from a few hundred products. Googlebot dutifully crawls thousands of ?sort=price-asc variants of the same list. That's where a genuine crawl budget gets incinerated on large sites — not on your 200 posts.
The fix isn't noindex (still gets crawled). It's not generating crawlable links to junk combinations in the first place, plus robots.txt on parameter patterns you'll never want.
Look at your parameter URLs, not your content.
The leak is in the navigation, not the articles.
Budget Myths
@CrawlBudgetMyths
The real crawl waste is your faceted navigation, not your blog
Этот пост опубликован в Telegram-канале Budget Myths. Подписаться можно по ссылке: @CrawlBudgetMyths.