Work Through an A/B Test Readout
Read an A/B test by calculating conversion rates, absolute lift, relative lift, uncertainty, and decision implications.
worked-trail stat-tile-trio common-trap-callout Control has 255 conversions from 5,000 visitors. Variant B has 280 conversions from 5,000 visitors. Decide whether the launch claim is earned. Experiment readout = rates + absolute lift + relative lift + uncertainty + guardrails + decision rule. Relative lift can make a small, uncertain movement sound launch-ready. A 9.8% relative lift is only 0.5 percentage points here, and the interval still includes harm. Compute rates Control = 255 / 5,000 = 5.1%; Variant B = 280 / 5,000 = 5.6%. Start with observed rates so everyone can see the raw scale before interpreting lift. Absolute…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in