Crawl & Render
Crawl & Render
@CrawlAndRender

Blocking /assets/ in robots.txt drops you into degraded render

Blocking /assets/ in robots.txt drops you into degraded render

Across 203 domains, 17% disallowed CSS/JS directories in robots.txt. Google then renders a broken layout and misjudges mobile-friendliness and content visibility.

— Sites blocking render assets: 17.0% ▓▓░░░░░░░░
— Affected pages flagged 'content hidden': 29.0%
— Mobile-usable rate vs. clean sites: ↓ 21 pts
— Median ranking pages losing visibility: 140

Failure mode: a legacy Disallow: /assets/ blocks the very files needed to paint the page. The renderer can't see content that's styled in or loaded by blocked scripts.

Fix: explicitly Allow CSS/JS. The renderer must fetch every resource a browser would. Cohort that unblocked assets saw mobile-usable rate climb from 73% to 94% (↑ 21 pts).

So what: robots.txt is for crawl control, not for hiding your own stylesheet.
Этот пост опубликован в Telegram-канале Crawl & Render. Подписаться можно по ссылке: @CrawlAndRender.
tech

Свежие посты в категории «Tech Infrastructure»

Все каналы категории →

start

Готовы запустить рекламу через сеть public.tg?

Новый оффер, продукт, GEO, кейс, событие или партнёрский запуск — соберём маршрут под задачу и отдадим медиаплан.

Telegram для медиаплана: @AFFtop_connect. Быстрый тест: $20 за канал, $1000 за пакет по сети.