AG-008Agent · Using toolslayaeval.ToolInputAccuracy

Tool Input Accuracy

Are the values sent to the tool correct?

Simulation state:

When it passes

All values make sense.

Threshold satisfied: evaluation score >= 3.0.

When it fails

A date that isn't a date.

Violation detected: execution flagged for human review or fallback routing.

SDK Specification

Parameter	Value	Description
Class	ToolInputAccuracy	Python evaluator class in layaeval
Required Fields	"task", "tool_schema", "tool_input"	Arguments expected in the call signature
Default Threshold	>= 3.0	Passes when quality score is at or above this value
Category	Agent Evaluation	Using tools (Right tool, right inputs, results actually used.)

Python Example

pip install layaeval

tool-input-accuracy.py

1from layaeval import ToolInputAccuracy
2
3metric = ToolInputAccuracy(threshold=3.0)  # passes at or above 3.0
4
5res = metric(
6    task="Book a hotel in Paris for 2 guests on Mar 4.",
7    tool_schema={"city": "str", "date": "str", "guests": "int"},
8    tool_input={"city": "Paris", "date": "2026-03-04", "guests": 2},
9)
10
11print(res.passed, res.value, res.confidence)