Mistake: reading mobile vs desktop crawl from logs without UA splitting
After mobile-first indexing, lumping all Googlebot together hides under-crawling of your mobile pages. Reads:
→ Google Search Central (mobile-first) — Googlebot Smartphone is the primary crawler now; Desktop visits are residual.
Takeaway: if Desktop dominates your logs, something's redirecting or cloaking.
→ Web.dev (serving variants) — How Vary and separate URLs change what each crawler sees.
Takeaway: confirm both UAs get the same content and status.
★ Pick of the week — a split-by-UA awk recipe — Buckets daily fetches into Smartphone / Desktop / Image.
Takeaway: a sudden Desktop surge usually means a mobile rendering or block issue.
Logfile Roundup
@LogfileRoundup
Mistake: reading mobile vs desktop crawl from logs without UA splitting
Этот пост опубликован в Telegram-канале Logfile Roundup. Подписаться можно по ссылке: @LogfileRoundup.