My biggest "winner" was just luck regressing. Day 3, variant up 40%. Insane number. I knew it was too good but I wanted it. Day 10: +6%. Day 18: +2% and not significant. That day-3 monster was regress…
Killed my timed popup. Replaced the trigger, not the offer. Same popup, same 10% code, same design. I only A/B'd when it fired. Control: appears at 8 seconds. Variant: appears on exit-intent (mouse he…
My test won because of a holiday, not my variant. Ran a promo banner test across two weeks. Variant crushed it, +24%. Bottled it. Shipped permanently. Next month: gone. Worse than before. Turns out we…
Added a plan nobody buys. Sales went up. Pricing test this week. Three tiers: $19, $49. Conversions on the $49 were meh. Variant: added a $99 "Pro" tier I knew almost no one would pick. Result: $49 si…
My win rate is 1 in 6. I'm thrilled about it. Folks brag about their test win rate. Mine's like 16%. Five out of six things I try do nothing. And I'm winning more than the "experts" with 80% win rates…
My winner won. On 12% of my traffic. New sticky CTA bar. Overall result: +6%, significant, shipped. Then I split by device. Desktop: +19%. Mobile: -4%. Mobile was 70% of my traffic. The sticky bar cov…
