Interpret a mixed experiment result by balancing local metric lift against North Star guardrails.
Experiment result: invites sent rose 24% after a persistent referral banner launched. Invite acceptance quality fell, invited-user activation declined, and the North Star of weekly active teams completing core workflows did not improve in the observed window. A local lift is not a clean win when the guardrails that sit closer to durable value weaken at the same time. The common shortcut is to say, “the test worked, but we can optimize the quality later.” That reasoning separates the target metric from the value system it is supposed to serve. In practice, it often locks in a noisy behavior and…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in