Handle a conflicting answer from your document assistant
Diagnose conflicting retrieval answers by tracing whether the issue is stale docs, weak filtering, or broken chunk boundaries.
Answer drift Same question, different answer. The visible symptom is generation, but the hidden cause is often retrieval design. A calm diagnosis path beats random prompt tweaking. The debug path Source, scope, then segment Diagnose conflicts in the order most likely to remove large classes of errors quickly. Do not start with the prompt Start where evidence enters the system. Conflicts shrink when the candidate evidence set becomes coherent. Retrieval quality sets the consistency floor. First check Source hygiene The assistant cites a pilot policy from February even though Legal replaced it in May. What do you inspect first? Second…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in