Conversion Lab Notes
Conversion Lab Notes
@ConversionLabNotes

Report the confidence interval, not just 'significant': a +0.4% win with a [−3%, +4%] interval is a coin flip

Report the confidence interval, not just 'significant': a +0.4% win with a [−3%, +4%] interval is a coin flip wearing a badge.
The p-value tells you if there's an effect; the interval tells you if you should care.
— Always quote the CI on relative lift, not the point estimate alone.
— If the interval spans zero, you have nothing — regardless of the p-value.
— If it sits entirely above your MDE, ship with confidence.
— If it's positive but partly below MDE, you have a direction, not a decision.
A point estimate without its interval is a number pretending to be a fact. Read the number, not the story. [report CI, 95%]
Этот пост опубликован в Telegram-канале Conversion Lab Notes. Подписаться можно по ссылке: @ConversionLabNotes.
tech

Свежие посты в категории «Tech Infrastructure»

Все каналы категории →

start

Готовы запустить рекламу через сеть public.tg?

Новый оффер, продукт, GEO, кейс, событие или партнёрский запуск — соберём маршрут под задачу и отдадим медиаплан.

Telegram для медиаплана: @AFFtop_connect. Быстрый тест: $20 за канал, $1000 за пакет по сети.