Write a Metamorphic Test for a Summarizer
Design a metamorphic relation that tests an AI summarizer without exact output matching.
A meeting summarizer produces variable but plausible recaps. The team needs a regression test that catches hallucinated decisions without requiring one exact summary. Define a transformation and an invariant: when the input changes in a controlled way, the output must preserve or drop specific facts accordingly. The common trap is writing a vague rule like summary should still be good. That is not a test. A metamorphic relation must say what changes, what stays true, and how failure is detected. Choose invariant Pick the property that must hold across acceptable summaries: decisions and owners must match source facts. The invariant…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in