Setting up a new testing tool right (the 8-step config)

Setting up a new testing tool right (the 8-step config)

Switched tools last quarter and almost ran a month of dirty data because I skipped setup. Don't be me. New tool, run this before test one:

— Install the snippet in the , synchronous, above everything else. Async = flicker.
— Enable anti-flicker / hide-page mechanism. Test it on slow connection.
— Connect it to your analytics so segments line up. Same user IDs both sides.
— Set sticky bucketing: a user always sees the same variant. Non-negotiable.
— Define ONE primary goal. Pick guardrail metrics too (bounce, revenue).
— Exclude internal traffic by IP. You'll skew everything otherwise.
— Run an A/A test first. Same page both sides. If it shows a 'winner,' your setup is broken.
— THEN run your first real test.

That A/A test catches 90% of config bugs. Skip nothing.

Go run an A/A test before you trust your new tool. Seriously.