Stack Curator
Stack Curator
@StackCurator

Instrument an A/B test so the result is actually trustworthy

Instrument an A/B test so the result is actually trustworthy
The setup checklist before you read a single p-value.

1 — Assign variants server-side and persist the assignment to the user record.
Why: client-side flicker and re-randomization on reload silently corrupt your splits.

2 — Fire an 'exposure' event only when the variant actually renders.
Why: counting assignment instead of exposure inflates your denominator with users who never saw it.

3 — Lock your primary metric and sample size before launch.
Why: deciding the metric after seeing data is how noise becomes a 'win'.

4 — Add a guardrail metric you'd never want to harm.
Why: a checkout lift that tanks refunds isn't a win; instrument the thing you're afraid to break.

That's the stack for this week. Forward to a teammate.
Этот пост опубликован в Telegram-канале Stack Curator. Подписаться можно по ссылке: @StackCurator.
tech

Свежие посты в категории «Tech Infrastructure»

Все каналы категории →

start

Готовы запустить рекламу через сеть public.tg?

Новый оффер, продукт, GEO, кейс, событие или партнёрский запуск — соберём маршрут под задачу и отдадим медиаплан.

Telegram для медиаплана: @AFFtop_connect. Быстрый тест: $20 за канал, $1000 за пакет по сети.