Skip to main content
EXPERIMENT-DESIGN5 MIN READ

Quick Reference: Power Planning Inputs

Recall the inputs required for a practical power conversation and the common shortcut that makes tests inconclusive.

What inputs do you need for a basic two-group power plan? Baseline rate, meaningful effect size, alpha, target power, traffic volume, and treatment/control split. Without these, runtime estimates are guesses dressed as math. Which planning move is stronger? Power serves the decision; it does not replace the decision threshold. “Any statistically significant lift is good enough, so we do not need to argue about practical significance.” Your line Statistical significance only says the effect is unlikely under the null at the chosen threshold. We still need to know whether the effect is large enough to justify rollout. It separates detectable…

Read the full lesson

Sign up free — one personalized lesson every day, matched to your role and goals.

Already have an account? Sign in

← Back to library
Contact us