Write A Multi-Dimension Rubric

Reviewers score a contract-review agent with one vague quality score, and comments mix correctness, usability, and confidentiality concerns. ISO/IEC 25010-style quality dimensions The common shortcut is a single 1-5 rating labeled quality. That makes reviewer disagreement impossible to debug because one person may penalize confidentiality, another may reward concise prose, and a third may focus only on legal correctness. Choose dimensions Select dimensions tied to agent risk: correctness, reliability under missing evidence, usability for human review, and security/confidentiality. The dimensions should reflect independent ways the agent can succeed or fail. If the fix would be different, the dimension should probably…

Sign up free — one personalized lesson every day, matched to your role and goals.

Already have an account? Sign in