<b>Putting Cloudflare in front of your site doesn't change your crawl budget</b>

<b>Putting Cloudflare in front of your site doesn't change your crawl budget</b>

There's a belief that a CDN "improves crawl budget" because Googlebot hits cached, fast responses. It improves crawl <i>capacity</i>, the speed half, and that's genuinely useful if your origin was slow. But capacity was probably never your constraint.

Here's the subtler trap: aggressive caching and bot-management rules can <i>hurt</i> you. If your CDN serves Googlebot a stale cached version, Google indexes old content. If your firewall rate-limits or challenges Googlebot as suspicious traffic, you've throttled crawling at the edge without realizing it, and it won't show as a server error in your origin logs.

So check that real Googlebot is allowlisted, not just "verified bots," and that you're not serving it a cache from last Tuesday.

A CDN can speed up crawling. It can also quietly sabotage it.