Myth: optimize crawl budget so Google indexes your pages
Crawl-budget anxiety drives small sites to obsess over crawl-efficiency tweaks. For most authority sites under a few thousand URLs, crawl budget is a non-issue.
Google has stated crawl budget matters mainly for very large sites (hundreds of thousands of URLs) or sites with many low-value parameterized pages. A 500-page niche site is crawled comfortably; pages "not indexed" there almost never reflect a budget shortfall.
The real reason small-site pages don't get indexed is usually quality/selection — Google crawls them and chooses not to index ("Crawled - currently not indexed"). That's an evaluation decision, not a budget one. Blocking CSS or trimming a sitemap won't fix it.
— If pages aren't indexed on a small site, improve their value and demonstrated demand, don't chase crawl efficiency
— Reserve crawl-budget work for genuinely large or parameter-heavy sites
Method note: Google's crawl-budget documentation; the distinction between "discovered/crawled - not indexed" states in Search Console.
Confidence: high
The Authority Files
@AuthorityFiles
Myth: optimize crawl budget so Google indexes your pages
Этот пост опубликован в Telegram-канале The Authority Files. Подписаться можно по ссылке: @AuthorityFiles.