AG-017Agent · Final resultlayaeval.AgentAnswerCompleteness

Answer Completeness

Did the final reply cover every part of the task?

PARTS OF THE TASKFind a hotelBook the roomSend the receiptWhole task covered
Simulation state:
When it passes

Everything covered.

Threshold satisfied: evaluation score >= 3.0.

When it fails

Parts left out.

Violation detected: execution flagged for human review or fallback routing.

SDK Specification

ParameterValueDescription
ClassAgentAnswerCompletenessPython evaluator class in layaeval
Required Fields"task", "response"Arguments expected in the call signature
Default Threshold>= 3.0Passes when quality score is at or above this value
CategoryAgent EvaluationFinal result (Is the last message true, complete and correct?)

Python Example

pip install layaeval
answer-completeness.py
1from layaeval import AgentAnswerCompleteness
2
3metric = AgentAnswerCompleteness(threshold=3.0) # passes at or above 3.0
4
5res = metric(
6 task="Book a hotel in Paris for 2 guests on Mar 4.",
7 response="Paris is the capital of France.",
8)
9
10print(res.passed, res.value, res.confidence)

Related Agent Checks

Other checks in Final result

View all 42 checks →