Score an Answer for Faithfulness
Compute a simple faithfulness score by checking answer claims against retrieved context.
Answer: Vendor review takes 5 business days, requires security approval for data processors, and is available to all suppliers. Retrieved context supports the first two claims and says only active contracted suppliers can request review. Faithfulness score = supported answer claims divided by total answer claims. A citation near the topic can make the whole answer feel grounded, but the unsupported eligibility claim still makes the response unfaithful. Split the answer Claim 1: review takes 5 business days. Claim 2: data processors require security approval. Claim 3: all suppliers can request review. Atomic claims make the review concrete. Check support…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in