llms.txt is a vanity file. A well-configured robots.txt does more for AI visibility.
No major model crawls llms.txt to decide what to cite — it's a proposal cosplaying as a standard. Meanwhile, half the sites crying "AI stole my traffic" are blocking GPTBot and ClaudeBot in robots.txt and don't even know it.
You can't get cited by crawlers you've locked out.
Fix your robots.txt before you write a single llms.txt line. Fight me.
Overview Hot Take
@OverviewHotTake
llms.txt is a vanity file. A well-configured robots.txt does more for AI visibility.
Этот пост опубликован в Telegram-канале Overview Hot Take. Подписаться можно по ссылке: @OverviewHotTake.