This week: button color vs button verb Everyone wants to test green vs orange. Snooze. I tested the VERB instead. Same button, same color. Just changed 'Get Started' to 'Get My Free Audit.' Setup: landing page for a CPA …
@SplitTestStreet
I almost shipped a fake winner This week I ran a hero test. Variant B up 14%. I was reaching for the ship button. Then I checked the split. 52/48. Supposed to be 50/50. That gap is sample ratio mismatch. Means something …
@SplitTestStreet
Testing a pricing page without nuking revenue Pricing tests scare people because you can torch real money. I run them in a safe order, lowest risk to highest: — Start with layout, not price. 3 tiers vs 2. Toggle position…
@SplitTestStreet
Day 2 of the test and I peeked. Big mistake. Variant B was crushing. +22%. I texted my partner 'we found it.' Day 5: +3%. Day 8: dead even. That early spike was noise. Small samples swing wild. If you call it on day 2 yo…
@SplitTestStreet
I optimized clicks and accidentally tanked revenue. Product grid test. New layout pushed cheaper items up top. Add-to-carts jumped 14%. I cheered. Guardrail metric: average order value. Down 22%. People bought, just boug…
@SplitTestStreet
I kept a 5% holdout. It exposed my fake gains. This is the move that changed how I trust my own dashboard. All year I shipped 'winners.' Dashboard said I was up huge, cumulatively. Felt like a genius. Then I checked my 5…
@SplitTestStreet
