Myth: one test result covers all your traffic Ran a hero test. Variant won +7% overall. Shipped sitewide. Done, right? Wrong. I segmented after the fact. Desktop: +19%. Mobile: -6%. The blended +7% hi…
Myth: your testing tool tells you when there's a winner That green 'Significant!' badge feels like gospel. It's a sales feature. Most tools flash significance the instant you cross the threshold — whi…
Myth: low-traffic sites can't run A/B tests 'You need millions of visitors, don't bother.' Heard it from a CRO 'expert.' It's lazy. Low traffic doesn't mean no testing. It means test BIGGER swings and…
Myth: a winning variant stays a winner forever Won a CTA test in March. Shipped it. Moved on. Felt great. November: revenue per visitor on that page had quietly sagged back below where I started. The …
Myth: a full redesign will lift conversions Client wanted the big bang. New homepage, new everything, 'modernize it.' Six weeks of work. We A/B'd old vs new. New design: -11%. Eleven percent down. Pro…
Myth: copy is minor, layout is what moves conversions 'Move the form up, redesign the hero, that's where the money is.' Heard it a hundred times. Meanwhile my biggest single win this year was one word…
