Split Test Street
Split Test Street
@SplitTestStreet

Multivariate vs running A/B tests back-to-back

Multivariate vs running A/B tests back-to-back
Wanted to test headline (3) x button color (2) x image (2). That's an MVT temptation. 12 combos.
Did the math: my traffic needed 14 weeks to power all 12 cells. Fourteen. I'd be dead.
So I ran sequential A/Bs instead. Headline test week 1 (winner). Button test week 2 on the winning headline. Image week 3. Done in 3 weeks, not 14.
The catch: sequential misses interaction effects. Maybe red button only wins WITH headline B. MVT would've caught that.
My rule: MVT only when you have monster traffic AND suspect interactions. Otherwise sequential, always.
Go count how many weeks your next MVT actually needs. The number will scare you straight. Report back.
Этот пост опубликован в Telegram-канале Split Test Street. Подписаться можно по ссылке: @SplitTestStreet.
buyer

Свежие посты в категории «Buyer Tactics»

Все каналы категории →

start

Готовы запустить рекламу через сеть public.tg?

Новый оффер, продукт, GEO, кейс, событие или партнёрский запуск — соберём маршрут под задачу и отдадим медиаплан.

Telegram для медиаплана: @AFFtop_connect. Быстрый тест: $20 за канал, $1000 за пакет по сети.