Sort Retrieval Metrics by Question
Choose retrieval metrics based on whether the team cares about clean top results, missing relevant records, rank order, or graded relevance.
Sort each product question into the retrieval metric that best answers it. Precision at k Recall at k MAP or NDCG Are the first five citations clean enough for a user to trust? How many of the final three chunks are actually relevant to the question? Did the known answer passage appear anywhere in the top 20 candidates? Can the reranker see the right document inside its candidate pool? Across many queries, are relevant documents appearing earlier in the ranked list? How do we score perfect, partial, and weakly related passages with rank position considered?
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in