28 October 2026
Hreflang canonical conflict: audit the URL set, not one page Bottom line first: A hreflang canonical conflict occurs when alternate-language URLs point to different canonical targets. Keep one canonical per page and make…
@CrawlAndRender
19 October 2026
Myth: "noindex stops Google from crawling the page" Sample: 1,940 noindex URLs across 96 domains, 90-day log window. Median Googlebot hits per noindex URL after the directive was applied: — Days 1-30: 6.2 hits ▓▓▓▓▓▓░░░░…
@CrawlAndRender
12 October 2026
Myth: "Crawl budget doesn't matter under 10k URLs" Sample: 287 audited domains, all under 10k indexable URLs. Median wasted crawl share (non-200, redirects, faceted noise): — Under 1k URLs: 19.4% ▓▓░░░░░░░░ — 1k-5k URLs:…
@CrawlAndRender
09 October 2026
Playbook: capture a pre-migration crawl baseline Migrations without a frozen baseline lose a median 14.6% of organic sessions; with one, median loss is 3.1% (sample: 52 migrations). Capture before you touch anything: — S…
@CrawlAndRender
05 October 2026
Playbook: a repeatable monthly tech-audit checklist Teams running a fixed monthly checklist catch regressions a median 22 days faster than ad-hoc auditors (sample: 28 in-house teams). The 6-metric monthly pass: — Step 1:…
@CrawlAndRender
01 October 2026
Playbook: prune thin content to lift site-wide quality Sites that pruned the bottom 18% of thin URLs saw median indexation of the remainder rise 7.3pp ↑ (sample: 44 prune projects). Steps: — Step 1: score every indexable…
@CrawlAndRender
30 September 2026
Playbook: respond to a sudden crawl-rate spike Median benign crawl-rate sits within ±20% week-over-week. A spike >2.5x ▓▓▓▓▓▓░░░░ warrants triage (baseline from 90 monitored sites). Runbook: — Step 1: confirm the bot — r…
@CrawlAndRender
29 September 2026
Playbook: rebalance internal link distribution Median site: top 5% of pages hold 48% of internal links; the bottom 50% share 9% (sample: 119 crawls). Skew starves money pages. Procedure: — Step 1: crawl, count unique int…
@CrawlAndRender
27 September 2026
💡 Если по теме — посмотри @CacheCatch. Часто пишут page cache plugins.…
@CrawlAndRender
27 September 2026
Playbook: verify rendered-vs-raw content parity Median JS site: 14.2% of primary content (title, H1, body) differs between raw and rendered HTML (sample: 84 sites). Parity gaps = indexing risk. Check order: — Step 1: cap…
@CrawlAndRender
26 September 2026
Playbook: audit canonical consistency Median site: 9.6% of pages have a canonical conflict (canonical ≠ self, or chain) — sample: 162 crawls. Conflicts split indexing signals. Run: — Step 1: crawl, capture declared canon…
@CrawlAndRender
24 September 2026
Playbook: XML sitemap hygiene pass Median sitemap contains 12.3% URLs that are non-200 or non-canonical (sample: 201 sitemaps). Dirty sitemaps depress trust in the whole file. Checklist: — Step 1: fetch every sitemap URL…
@CrawlAndRender
23 September 2026
Playbook: contain a faceted-nav crawl explosion Uncontrolled facets generate a median 47x more crawlable URLs than products (sample: 38 e-commerce crawls). Worst case observed: 410x. Containment sequence: — Step 1: enume…
@CrawlAndRender
22 September 2026
Playbook: stand up a crawl-efficiency dashboard Define crawl efficiency = unique indexable 200s crawled ÷ total crawl requests. Median = 0.62; best-in-class ≥0.80 (sample: 130 sites). Build it: — Step 1: nightly job pars…
@CrawlAndRender
21 September 2026
Playbook: find and reconnect orphan pages Median site: 8.9% of indexable URLs receive zero internal links (sample: 156 audits). Orphans get a median 4.2x fewer crawls. Steps: — Step 1: build crawl-URL set (followed inter…
@CrawlAndRender
20 September 2026
Playbook: clean redirect chains in priority order Median site carries 3.4% of URLs in chains ≥2 hops; p90 chain length = 4 (sample: 188 crawls). Each extra hop leaks ~crawl efficiency. Order of operations: — Step 1: craw…
@CrawlAndRender
19 September 2026
Playbook: flatten page depth to lift indexation URLs at click-depth ≥5 are indexed at 51.8% vs. 86.4% at depth ≤3 (sample: 142 sites). Depth is a strong indexation predictor. Procedure: — Step 1: crawl, record shortest-p…
@CrawlAndRender
16 September 2026
Playbook: diagnose a falling indexation rate in 5 steps Median healthy indexation (indexed ÷ submitted) sits at 89.4% across 168 audited domains; p10 sites run 61.2%. Work top-down: — Step 1: pull Page Indexing report, c…
@CrawlAndRender
15 September 2026
Playbook: triage crawl budget from 30 days of logs Median site wastes 38.2% of crawl hits on non-indexable URLs (sample: 214 audited domains). Run this in order: — Step 1: parse 30d of access logs, filter UA to verified …
@CrawlAndRender
14 September 2026
Last-Modified header vs. sitemap lastmod: crawl-freshness signals Both tell Google when content changed; trustworthiness decides if it listens. Audited 76 domains. — Sitemap lastmod, accurate (matches real edits): recraw…
@CrawlAndRender
13 September 2026
Internal search pages vs. faceted nav: which to noindex Both generate near-infinite low-value URLs, but the crawl-budget profiles differ. Measured on 53 e-commerce domains. — Internal search results (?q=): median 0.3% dr…
@CrawlAndRender
12 September 2026
robots.txt vs. meta robots vs. X-Robots-Tag: pick by file type Three directive layers, three jobs. Audited mis-application across 81 domains. — Trying to noindex a PDF/image with meta tag: fails (no HTML head) — found on…
@CrawlAndRender
11 September 2026
Lab data vs. CrUX field data: which gates your render budget Lighthouse lab and CrUX field measure different things and disagree often. Compared LCP on 90 templates. — Lab (Lighthouse, throttled): controlled, single-run,…
@CrawlAndRender
10 September 2026
hreflang in sitemap vs. HTML head: error rates compared Same directive, three delivery methods. Audited error rates across 67 multilingual domains. — HTML head tags: median 14.2% URLs with return-tag errors ▓▓▓▓▓░░░░░ — …
@CrawlAndRender
09 September 2026
Full crawl vs. stratified sample: the audit-time tradeoff On sites over 1M URLs, a full crawl is often theater. Compared full vs. stratified-sample audits on 44 large domains for issue-detection accuracy. — Full crawl: 1…
@CrawlAndRender
08 September 2026
rel=canonical vs. 301 for duplicate consolidation Across 112 domains deduping parameter and variant URLs, both consolidate — but the enforcement strength differs. — 301 redirect: Google honored canonical choice 99.1% ▓▓▓…
@CrawlAndRender
07 September 2026
Adjacent but useful: @push101_guide. Push traffic explained from zero: what subscribers are, how to read CTR, your first… Good if your work touches Push traffic.…
@CrawlAndRender
06 September 2026
URL Inspection live render vs. Rich Results Test Both show "Googlebot's rendered HTML," but they're not interchangeable. Compared output on 64 JS pages. — Both use evergreen Chromium render ▓▓▓▓▓▓▓▓▓▓ — Rich Results Test…
@CrawlAndRender
05 September 2026
Default UA vs. Googlebot UA: what your audit hides Ran paired crawls — default crawler UA vs. spoofed Googlebot Smartphone — on 102 sites. — Identical responses: 79.4% ▓▓▓▓▓▓▓▓░░ — Different status code under Googlebot: …
@CrawlAndRender
04 September 2026
Crawl depth vs. click depth: the metric people conflate Across 134 domains, crawl depth (hops from the crawl seed) and click depth (shortest path from homepage) correlated at only r=0.62 — weaker than most assume. — Page…
@CrawlAndRender