<b>I built a whitelist on 200 conversions and it lied to me</b>

<b>I built a whitelist on 200 conversions and it lied to me</b>

Whitelisting felt like the smart, disciplined move. It was just survivorship bias with a spreadsheet.

<i>The setup</i>
— Pop traffic, e-commerce CPL, $5.50 payout, source had ~9,000 publisher zones.
— After ~200 conversions I cut to the top 40 zones and went whitelist-only.

<i>The move</i>
Concentrated full budget into the "proven winners" to stop wasting spend on the long tail.

<i>The numbers (illustrative)</i>
— Week 1 on whitelist: ROI 38%, looked validated.
— Week 3: ROI -12%. Those 40 zones were small, fatigued fast, and several were lucky noise to begin with.

<i>The lesson</i>
200 conversions across thousands of zones means most "winners" have 2-4 conversions each, statistically indistinguishable from random. I locked in noise and starved myself of the next winners hiding in the tail.

<i>What I'd do differently</i>
Blacklist losers aggressively, whitelist slowly. Cut zones with spend = 3x payout and zero conversions, but keep exploring the tail until winners have enough volume (~10+ conversions) to actually trust. A whitelist is a tomb, build it last.