How does this affect me?
The Tool & Topic Invocation Grader verifies that an agent invoked required tools or topics during an evaluation run. While traditional graders focus on response quality, this grader validates execution behavior and orchestration logic.
Makers define a list of mandatory tools or topics per run. During execution, the grader checks whether the specified items were invoked. Key capabilities of this feature include:
- Detection of missing or broken tool calls.
- Validation of routing and orchestration flows.
- Early identification of behavior regressions.
- Clear feedback indicating which tools or topics were not invoked.
This message is for awareness, and no action is required.