Evaluators
Generating Evaluators
Learn how to automatically generate evaluators for your agents
Generate Evaluators API
Generate new evaluators automatically with specified configurations.
API Endpoint
Method | Endpoint |
---|---|
POST | https://new-prod.vocera.ai/test_framework/v1/scenarios-external/generate/ |
Authentication
Include your API key in the request headers:
Header | Description |
---|---|
X-VOCERA-API-KEY | Your API key obtained from the dashboard |
Request Parameters
Parameter | Type | Required | Description |
---|---|---|---|
agent_id | integer | Yes* | ID of the agent to generate evaluators for |
assistant_id | string | Yes* | The assistant ID associated with agent to generate evaluators for |
num_scenarios | integer | Yes | Number of evaluators to generate |
extra_instructions | string | No | Additional instructions for scenario generation |
information_fields | object | No | Key-value pairs of information to include in scenarios |
personalities | array | No | Array of personality IDs to use |
first_message | string | No | Initial message for the conversation |
inbound_phone_number | integer | No | ID of the inbound phone number (See inbound numbers) |
* Only either of agent_id
or assistant_id
is required
Example Request Body
Response Format
The API returns an array of generated evaluator objects.
Response Fields
Field | Type | Description |
---|---|---|
id | integer | Unique identifier for the evaluator |
name | string | Name of the evaluator |
agent | integer | ID of the associated agent |
personality | integer | ID of the personality used |
personality_name | string | Name of the personality |
tags | array | List of tags associated with the evaluator |
runs | array | List of evaluator run IDs |
metrics | array | List of metric IDs |
metric_names | array | List of human-readable metric names |
first_message | string | Initial message for the conversation |
inbound_phone_number | integer|null | ID of the inbound phone number |
inbound_phone_number_data | object|null | Details about the inbound phone number (see below) |
instructions | string | Generated evaluator instructions |
Inbound Phone Number Data Fields
Field | Type | Description |
---|---|---|
id | integer | Internal ID of the phone number record |
number | string | The phone number in E.164 format |
phone_number_id | string | External reference ID for the phone number |