Turn pilot data into an item decision
Use item difficulty, discrimination, and qualitative review to decide whether to keep, revise, or retire an item.
Item 7: 31 percent correct, negative discrimination, and learner comments saying two answers seemed right. Use pilot stats as flags, then diagnose with content review. Calling every low-correct item "rigorous" can preserve broken items and punish stronger learners who overthink ambiguity. Before Keep Item 7 because it is hard and the assessment needs stretch. After Revise Item 7 because negative discrimination plus comments point to an ambiguous key. 1 Read difficulty: 31 percent correct means the item is hard or unclear. Difficulty alone does not decide quality. 2 Read discrimination: negative means high scorers missed it more than low scorers.…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in