Commit To A Risky-Case Golden Set
Commit to adding specific high-risk cases to an agent evaluation set.
Add high-risk cases to a real agent golden set Use this when an agent eval has broad coverage but misses a known risky class such as tool timeouts, policy exceptions, confidential data, boundary overreach, or escalation failures. By [date], I will add [number] cases for [agent] covering [risk class]. These cases answer the question: [GQM question]. A severe failure is: [blocker rule]. I will rerun the eval and record whether launch scope changes. We will check whether the cases were added, whether the blocker rule was written, and whether the rerun changed the launch decision. A support agent has no…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in