Respond to a failed experiment by extracting bounded learning before deciding whether to stop, iterate, or retest.
EXPERIMENT RECOVERY An activation email test reduced overall clicks by 11%. The team is tempted to abandon the entire onboarding angle. What should the analyst recommend first? Run a short postmortem on hypothesis, audience, timing, creative, and measurement before deciding stop or iterate. Strong. It keeps the miss bounded and extracts learning before making a broad decision. Kill the onboarding angle because the aggregate result shows users disliked it. Weaker. It treats one condition as pervasive proof and may throw away segment-level learning. Repeat the exact same test because one failure is not enough evidence. Weaker. Persistence without learning ignores…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in