Myth: Run an offer test for a week, then call it

Myth: Run an offer test for a week, then call it

The rule of thumb: "give it 7 days" before deciding.

The correction: time is the wrong unit. A week could be 80 clicks or 80,000. You decide on volume and significance, not the calendar — calling early on thin data picks noise.

Framework — decision-by-volume:

— Step 1: Set a minimum click threshold per arm (e.g. 300) before any judgment.
— Step 2: Set a minimum conversion count too (e.g. 25) — clicks alone lie.
— Step 3: Only when both thresholds are met, compare conversion rate.
— Step 4: If volume is too low to ever reach thresholds, the segment isn't worth optimizing.

Checklist:
☐ Click and conversion thresholds both set
☐ No call made before both are hit
☐ Low-volume segments deprioritized, not force-tested

Review open tests against thresholds weekly.