28 October 2026
"How long do I run a test?" Wrong question. Beginners ask days. Days don't matter. Sample size and full week-cycles matter. My rule: — Minimum 1 full business cycle. Mon-buyers behave nothing like Sun-buyers. — Stop only…
@SplitTestStreet
25 October 2026
Myth: high confidence means a big, real lift People conflate two things and it costs them. Confidence (am I sure there's a difference?) is NOT effect size (how big is it?). With enough traffic you can hit 99% confidence …
@SplitTestStreet
19 October 2026
Myth: trust the UX team's gut, they're the experts Designer swore the new hero would crush. 'Cleaner, more whitespace, obviously better.' I believed her. She's good. We tested anyway. Her clean hero: -8%. The 'cluttered'…
@SplitTestStreet
12 October 2026
Myth: more variants means you learn more, faster 'Test 5 headlines at once, find the best one!' Tempting. Math says no. Every extra arm splits your traffic and multiplies your false-positive risk. Five variants = five ch…
@SplitTestStreet
09 October 2026
Myth: an early lift proves the variant is better Day 2, my redesigned variant was up +18%. I was already writing the win-post in my head. Then it bled. Day 5: +9%. Day 10: +2%. Day 14: flat. That's novelty effect. Return…
@SplitTestStreet
05 October 2026
Myth: more clicks on the CTA means the test won New button copy got +22% clicks. I almost shipped on the spot. Almost. Checked the next step. Those extra clickers bounced off the next page. Net signups: -3%. The punchier…
@SplitTestStreet
01 October 2026
Myth: bigger sample is always better, run it longer 'Just let it run another month to be safe.' Sounds responsible. It's not free. Two costs nobody mentions. One: opportunity cost — every extra week you run a test, half …
@SplitTestStreet
30 September 2026
Myth: just follow proven best practices, skip testing 'Single-column forms convert better, everyone knows it, just do it.' So I did it. Without testing. Months later, bored, I tested it against our old multi-step form. T…
@SplitTestStreet
29 September 2026
Myth: a flat test was a waste of time 'No lift? Failed experiment.' Nah. A flat result is data, and it's saving your future self. I tested adding three trust badges to checkout. Result: dead flat. Zero movement. Felt lik…
@SplitTestStreet
27 September 2026
🔗 Рекомендуем @ViralityEngine — соседи по теме (meme formats).…
@SplitTestStreet
27 September 2026
Myth: one test result covers all your traffic Ran a hero test. Variant won +7% overall. Shipped sitewide. Done, right? Wrong. I segmented after the fact. Desktop: +19%. Mobile: -6%. The blended +7% hid a mobile loss beca…
@SplitTestStreet
26 September 2026
Myth: your testing tool tells you when there's a winner That green 'Significant!' badge feels like gospel. It's a sales feature. Most tools flash significance the instant you cross the threshold — which, if you've been c…
@SplitTestStreet
25 September 2026
Myth: low-traffic sites can't run A/B tests 'You need millions of visitors, don't bother.' Heard it from a CRO 'expert.' It's lazy. Low traffic doesn't mean no testing. It means test BIGGER swings and BIGGER metrics. On …
@SplitTestStreet
24 September 2026
Myth: a winning variant stays a winner forever Won a CTA test in March. Shipped it. Moved on. Felt great. November: revenue per visitor on that page had quietly sagged back below where I started. The 'winner' decayed. Wh…
@SplitTestStreet
23 September 2026
Myth: a full redesign will lift conversions Client wanted the big bang. New homepage, new everything, 'modernize it.' Six weeks of work. We A/B'd old vs new. New design: -11%. Eleven percent down. Problem with redesigns:…
@SplitTestStreet
22 September 2026
Myth: copy is minor, layout is what moves conversions 'Move the form up, redesign the hero, that's where the money is.' Heard it a hundred times. Meanwhile my biggest single win this year was one word. Hero CTA: 'Get sta…
@SplitTestStreet
21 September 2026
Myth: checking the test early doesn't hurt anything 'I just peek, I don't stop it.' Liar. You peek, you see green, you call it. We all do. Here's the dirty part: if you check daily and stop the first time you cross 95%, …
@SplitTestStreet
19 September 2026
Myth: always be testing, everything, all the time 'ABT! Never stop!' Sounds like a hustle. It's a trap. Run two tests on the same page at once and they pollute each other unless you isolate audiences. Run a test on a pag…
@SplitTestStreet
19 September 2026
Myth: more traffic means faster tests Guy on a call told me 'you've got 200k visits, you'll get answers in days.' Cute. Traffic isn't the bottleneck. Conversions are. To detect a 5% relative lift on a 3% baseline you nee…
@SplitTestStreet
17 September 2026
Myth: wait for 95% significance or it doesn't count Everybody parrots 95%. I did too. Then I learned where it came from: a stats convention from agriculture papers in the 1920s. Not your funnel. 95% means you accept a 1-…
@SplitTestStreet
16 September 2026
My subject-line testing routine for every send Email is the cheapest split-test lab you own. Instant feedback, free traffic. I never send a broadcast without testing the subject. Routine: — Write 2 lines from DIFFERENT a…
@SplitTestStreet
15 September 2026
Auditing a landing page to find your top 3 test targets New page lands on my desk and I don't guess what to test. I run a 5-pass audit, then rank. Each pass takes 5 minutes: — 5-second test: glance, look away. Can you sa…
@SplitTestStreet
14 September 2026
Setting up a new testing tool right (the 8-step config) Switched tools last quarter and almost ran a month of dirty data because I skipped setup. Don't be me. New tool, run this before test one: — Install the snippet in …
@SplitTestStreet
13 September 2026
Testing social proof, lever by lever 'Add testimonials' is not a test. Social proof has parts and they move differently. Here's the order I attack it: — Type: number-based ('12,000 users') vs face-based (photo testimonia…
@SplitTestStreet
12 September 2026
Running mobile and desktop as separate tests Blended a test once where B won overall. Split it after: B crushed on desktop, LOST on mobile. The average lied. Now I check device before trusting any result. Playbook: — Bef…
@SplitTestStreet
11 September 2026
Test won't reach significance? Run this diagnostic Day 28 and the thing is still flat at 91%. Maddening. Before you give up, walk this checklist. One of these is always the culprit: — Effect too small. Sub-5% differences…
@SplitTestStreet
10 September 2026
Building 4 headline variants fast (my fill-in formula) Headline is the highest-leverage test on most pages and people freeze writing variants. I never start blank. I crank 4 from these angles: — Outcome angle: lead with …
@SplitTestStreet
09 September 2026
What I log after every test (the 7-field record) Undocumented tests are tests you'll re-run by accident in 6 months. Been there. Now every result gets the same 7 fields in one sheet: — Hypothesis (the one sentence I wrot…
@SplitTestStreet
08 September 2026
Optimizing a form, field by field Forms are where conversions go to die. I had a 7-field signup form bleeding 70% of starters. Here's the teardown order I used to claw it back: — Count fields. Every field over 3 is a tes…
@SplitTestStreet
07 September 2026
Adjacent but useful: @PositionZeroWire. Inside scoops on featured-snippet wins, losses and SERP test rollouts — who just… Good if your work touches featured snippets.…
@SplitTestStreet
