Apply 5 Whys to identify the process cause behind an AI output failure.
An AI contract assistant told a customer that a cancellation clause existed. The document had no such clause. 5 Whys: move from symptom to root cause and countermeasure. The novice move is to stop at "the model hallucinated" and swap models. That may reduce symptoms, but it misses retrieval, prompt, data, eval, and monitoring causes. Before Fix plan: switch to a stronger model and tell users to review answers carefully. After Fix plan: alert on failed ingestion, require source-linked clause answers, refuse when retrieval is empty, and add evals for missing-clause questions. Why 1 Why did the answer cite a…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in