worked-trail before-after common-trap-callout The model predicts renewal risk 30 days before contract end, but the feature list contains fields updated after renewal calls and aggregates computed through today. Leakage check = prediction moment + feature availability + fold-safe preprocessing + split reality. A model can look excellent by learning from fields that are unavailable in production. The score is then measuring hindsight, not prediction. Name prediction time Prediction moment = 30 days before contract_end_date. Every feature must be judged against this moment. Without a prediction time, availability is undefined. Audit feature availability Remove last_contact_outcome and renewal_discount_approved because both occur after…
Read the full lesson
Sign up free: one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in