Sort each experiment-brief card into the planning bucket it belongs to. Hypothesis Sample size Statistical significance Decision rule For new paid-search visitors, the shorter page should increase checkout starts Primary metric is checkout starts within the same session Baseline checkout-start rate is 6.0% Minimum detectable effect is +1.0 percentage point at 80% power Use alpha 0.05 for the pre-planned two-sided test Analyze after the planned sample is reached, not after the first green day Ship only if checkout starts pass and annual-plan selection does not decline If inconclusive, redesign the treatment rather than calling it a directional win chip-tray sort-buckets…
Read the full lesson
Sign up free: one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in