Sort: Build The Experiment Brief
Classify A/B test planning details by the part of the statistical framework they support.
Sort each experiment-brief card into the planning bucket it belongs to. Hypothesis Sample size Statistical significance Decision rule For new paid-search visitors, the shorter page should increase checkout starts Primary metric is checkout starts within the same session Baseline checkout-start rate is 6.0% Minimum detectable effect is +1.0 percentage point at 80% power Use alpha 0.05 for the pre-planned two-sided test Analyze after the planned sample is reached, not after the first green day Ship only if checkout starts pass and annual-plan selection does not decline If inconclusive, redesign the treatment rather than calling it a directional win chip-tray sort-buckets…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in