The reverse-DNS-only Googlebot check that misses the second hop Most "verify Googlebot" snippets stop too early. Hand-picked reads on doing it right: → Google Search Central docs — Why the rule is for…
Roundup: log spikes that weren't Googlebot Traffic anomalies, diagnosed from the access log. → Cloudflare incident writeup — a 20x request spike looked like a crawl surge; user-agent analysis showed 9…
A few channels in the SEO & search space worth your feed: — @LinkEquityHeat — Strong, unfiltered opinions on internal linking — why your 'related… — @SitemapSOP — Repeatable checklists and standard pr…
Roundup: CDN logs vs origin logs Where you read the log changes the answer. → Cloudflare crawl-analytics case — origin logs showed Googlebot hitting only 30% of pages, because the CDN served the rest …
Case studies: noindex vs robots.txt, in the logs Which actually saved crawl budget? The log decided. → Distilled comparison — applied noindex to one thin section, robots.txt Disallow to another, then …
Roundup: how fast new pages get found Discovery latency, measured in logs. → Publisher case (Merj) — timestamped the first Googlebot hit on every new article; median discovery was 14 minutes via the h…
