<b>Can a channel look profitable in every segment yet unprofitable overall — or the reverse?</b>

<b>Can a channel look profitable in every segment yet unprofitable overall — or the reverse?</b>

Yes, and it happens more in attribution data than practitioners realize. The culprit is Simpson's paradox, and it quietly corrupts channel decisions.

<b>The phenomenon</b>

Simpson's paradox is when an association that holds within every subgroup reverses or vanishes when the subgroups are pooled — because a lurking variable is distributed unevenly across them.

<b>How it bites attribution</b>

Suppose retargeting shows strong ROAS in aggregate. Split by audience: it's mediocre for genuinely new prospects and inflated only among already-intending buyers, who happen to dominate the pool. The aggregate number is real arithmetic but a false guide, because the mix is doing the work, not the channel. Conversely, a prospecting channel can look weak overall while being your only true demand-creator within the cold-audience segment that actually matters.

<b>The nuance</b>

This is the same disease as confounding, surfaced through aggregation. Blended ROAS, blended CPA, blended attribution credit — any pooled metric over heterogeneous audiences is a candidate for reversal. The fix isn't more decimals; it's the right conditioning variable.

<b>What to actually do</b>

— Always decompose channel metrics by audience temperature (cold prospect vs warm vs existing customer) before judging them.
— Be suspicious of any blended metric that aggregates over groups with very different baseline conversion rates.
— When subgroup and aggregate disagree, the subgroup view conditioned on the confounder is usually the decision-relevant one.

Bottom line for practitioners: the most dangerous attribution numbers are the cleanest-looking aggregates. Condition on audience intent before you reallocate, or the mix will fool you.