RAG-019RAG · Staying truthfullayaeval.ContradictionDetection

Contradiction Detection

Does the answer say the opposite of the sources?

Simulation state:

When it passes

They agree.

Threshold satisfied: evaluation score <= 0.20.

When it fails

They disagree.

Violation detected: execution flagged for human review or fallback routing.

SDK Specification

Parameter	Value	Description
Class	ContradictionDetection	Python evaluator class in layaeval
Required Fields	"context", "response"	Arguments expected in the call signature
Default Threshold	<= 0.20	Passes when risk score is at or below this value
Category	RAG Evaluation	Staying truthful (Does every line come from the pages, with nothing made up?)

Python Example

pip install layaeval

contradiction-detection.py

1from layaeval import ContradictionDetection
2
3metric = ContradictionDetection(threshold=0.20)  # passes when risk is at or below 0.20
4
5res = metric(
6    context="Paris is the capital of France.",
7    response="Paris is the capital of France.",
8)
9
10print(res.passed, res.value, res.confidence)