RAG-008RAG · Staying truthfullayaeval.HallucinationRisk

Hallucination Risk

Did the answer invent facts that aren't in the sources?

Simulation state:

When it passes

Nothing invented.

Threshold satisfied: evaluation score <= 0.30.

When it fails

A made-up fact slipped in.

Violation detected: execution flagged for human review or fallback routing.

SDK Specification

Parameter	Value	Description
Class	HallucinationRisk	Python evaluator class in layaeval
Required Fields	"retrieved_context", "response"	Arguments expected in the call signature
Default Threshold	<= 0.30	Passes when risk score is at or below this value
Category	RAG Evaluation	Staying truthful (Does every line come from the pages, with nothing made up?)

Python Example

pip install layaeval

hallucination-risk.py

1from layaeval import HallucinationRisk
2
3metric = HallucinationRisk(threshold=0.30)  # passes when risk is at or below 0.30
4
5res = metric(
6    retrieved_context="Paris is the capital of France, with 2.1M residents.",
7    response="Paris is the capital of France.",
8)
9
10print(res.passed, res.value, res.confidence)