Work Through a Leakage Check
Detect feature leakage by checking whether each predictor is available before the prediction moment.
worked-trail before-after common-trap-callout The model predicts renewal risk 30 days before contract end, but the feature list contains fields updated after renewal calls and aggregates computed through today. Leakage check = prediction moment + feature availability + fold-safe preprocessing + split reality. A model can look excellent by learning from fields that are unavailable in production. The score is then measuring hindsight, not prediction. Name prediction time Prediction moment = 30 days before contract_end_date. Every feature must be judged against this moment. Without a prediction time, availability is undefined. Audit feature availability Remove last_contact_outcome and renewal_discount_approved because both occur after…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in