Commit to a Metric Spec
Create a concrete metric specification for one recommender experiment.
Write a metric specification for a recommender experiment you will discuss or run this week Use this for a real recommender surface: homepage module, feed, push recommendation, search suggestions, marketplace carousel, or learning path. Recommender metric commitment Surface: [where recommendations appear] User job: [what the recommendation is meant to help the user do] Primary objective: [one metric that decides whether the change helped] Diagnostic metric: [one metric that explains behavior, such as CTR by slot or candidate pool size] Guardrails: [two metrics that can veto launch, such as hide rate, latency, complaint rate, coverage, diversity, or retention] Decision rule: We…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in