Escape review A production refund answer hallucinated a policy. The dashboard says refund evals were green at release time. If the team only patches the prompt, the same class of escape can return through data, oracle, or retrieval. Root cause analysis Ask why the test system missed it RCA moves from bad output to missed evidence. In AI testing, the root may sit in the case, context, oracle, harness, model, or gate. Patch Change the prompt and move on The escape becomes an improvement to the test system. Root cause is not the bad AI answer. Root cause is the…
Read the full lesson
Sign up free: one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in