Infinite scroll buried 80% of a catalog from Google
A fashion retailer had 40,000 products but Google had crawled 8,000. The pattern: infinite scroll with no paginated URLs. Here's the playbook that surfaced the rest.
— Crawl the category page as Googlebot. It saw page 1's 24 products, then a JS scroll listener — a dead end. No crawlable link to product 25+.
— Confirmed in logs: Googlebot hit each category root once and never went deeper.
The fix checklist for infinite scroll:
— Back every scroll 'page' with a real URL: ?page=2 that renders server-side
— Add rel="next" equivalents via crawlable <a href> in a <noscript> or footer pager
— Keep scroll for UX, but the pager must work with JS off
— Submit a paginated sitemap of every page URL
We added a server-rendered pager beneath the scroll.
Result: crawled products went 8,000 → 38,400 in 5 weeks, indexed products +290%, and category long-tail traffic climbed -0% baseline → +47% as deep products finally surfaced.
Hydrate Diaries
@HydrateDiaries
Infinite scroll buried 80% of a catalog from Google
Этот пост опубликован в Telegram-канале Hydrate Diaries. Подписаться можно по ссылке: @HydrateDiaries.