Quick Reference: Preflight Checklist For A/B Tests
Use a compact checklist to verify hypothesis, metric, sample size, and stopping rule before launch.
Checklist HMS What does HMS force you to check before launch? Hypothesis, metric, sample Stopping Fixed horizon versus sequential monitoring The stopping rule is part of the significance design. Missing item "We can fill in the MDE after launch once we see variance." A teammate wants to skip sample-size planning. Your line Variance estimates can improve, but the minimum effect worth detecting is a business decision we need before launch. Do not let observed lift become the MDE after the fact. It separates business threshold from statistical estimation. Assignment What randomization check belongs in preflight? Confirm the unit of randomization,…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in