<b>"I changed the title and traffic went up — the test worked."</b>
That's not a test. That's an anecdote with a date on it.
You changed one title, traffic rose, you declared victory. But Google updated three times that month, seasonality shifted, a competitor de-indexed a page, and your sample was one URL. You have no control group and no idea which of five things moved the number.
Real on-page SEO testing needs the boring apparatus: a control set of similar pages you <i>don't</i> change, the variant set you do, both tracked against the same time window, and enough URLs that one outlier doesn't swing the average. Tools like the bucket-testing approach SearchPivot and others use exist precisely because single-page "tests" are noise.
Minimum viable test: 20+ similar pages split into control and variant, same template change, 4-6 weeks, compare clicks via Search Console, not your gut.
One page going up proves a title changed and traffic changed. It proves nothing about why.
("It worked for me" is the most expensive sentence in SEO.)
Myth Off Page
@MythOffPage
<b>"I changed the title and traffic went up — the test worked."</b>
Этот пост опубликован в Telegram-канале Myth Off Page. Подписаться можно по ссылке: @MythOffPage.