Whitelisting felt like the smart, disciplined move. It was just survivorship bias with a spreadsheet.
The setup
— Pop traffic, e-commerce CPL, $5.50 payout, source had ~9,000 publisher zones.
— After ~200 conversions I cut to the top 40 zones and went whitelist-only.
The move
Concentrated full budget into the "proven winners" to stop wasting spend on the long tail.
The numbers (illustrative)
— Week 1 on whitelist: ROI 38%, looked validated.
— Week 3: ROI -12%. Those 40 zones were small, fatigued fast, and several were lucky noise to begin with.
The lesson
200 conversions across thousands of zones means most "winners" have 2-4 conversions each, statistically indistinguishable from random. I locked in noise and starved myself of the next winners hiding in the tail.
What I'd do differently
Blacklist losers aggressively, whitelist slowly. Cut zones with spend = 3x payout and zero conversions, but keep exploring the tail until winners have enough volume (~10+ conversions) to actually trust. A whitelist is a tomb, build it last.
Arb Files
@ArbFiles
I built a whitelist on 200 conversions and it lied to me
This post was published in the Telegram channel Arb Files (@ArbFiles). All its posts are on the channel page.
Open on Telegram