pre-registering a small A/B test or survey analysis an upcoming experiment where metric shopping or threshold drift could change the conclusion Subject-line A/B test with primary activation metric and unsubscribe guardrail Pricing survey with target population, sample size, and interval plan Feature experiment with conversion lift, retention guardrail, and stopping date I will state the metric, unit, denominator, uncertainty or spread, and the decision threshold before making the recommendation. When I write or review a sampled metric for a stakeholder then I will add uncertainty/spread and a decision threshold before sending Situation: Subject-line A/B test with primary activation metric and…
Read the full lesson
Sign up free: one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in