"I changed my title and traffic jumped 20% — proof it works."

"I changed my title and traffic jumped 20% — proof it works."

Probably not.

Here's the logical takedown: organic search has no holdout group. You changed the title on day one, and you're comparing to last week. But last week wasn't a control — it was a different week, with its own seasonality, its own SERP volatility, its own competitor edits, and a Google index that re-scores continuously.

A single before/after on one URL is an anecdote wearing a lab coat. To actually test on-page changes you need a population: split a few hundred similar pages into matched groups, change one set, hold the other, and compare the groups' trend against each other — a time-based or pattern-based split, the SearchPilot / statistical-SEO approach.

One page moving proves the index is alive. It proves nothing about your title.

(If your sample size is one, your conclusion is a coin flip you narrated.)