Add a test case

POST

https://apps.sarvam.ai/api/evals/v1/:org_id/:workspace_id/test-suites/:test_suite_id/test-cases

POST

/api/evals/v1/:org_id/:workspace_id/test-suites/:test_suite_id/test-cases

import requests
url = "https://apps.sarvam.ai/api/evals/v1/org_id/workspace_id/test-suites/test_suite_id/test-cases"
payload = {
    "name": "Caller reschedules to the weekend",
    "category": "Rescheduling",
    "user_scenario": "The caller has an appointment tomorrow morning but now wants a weekend slot. They are in a hurry, switch to Hindi midway, and ask twice whether a cancellation fee applies.",
    "expected_behaviors": [
        {
            "name": "Offers concrete slots",
            "description": "Proposes at least two specific dates and times instead of asking the caller to choose blindly."
        },
        {
            "name": "Confirms the new booking",
            "description": "Repeats the final date, time and clinic name back to the caller before ending the call."
        }
    ],
    "variable_overrides": [
        {
            "name": "patient_name",
            "value": "Meera"
        }
    ],
    "max_turns": 30
}
headers = {
    "X-API-Key": "<your-api-key>",
    "Content-Type": "application/json"
}
response = requests.post(url, json=payload, headers=headers)
print(response.json())

{
  "test_case_id": "01K5T8B7PS3KD9GM1FYX4VQCJ2",
  "test_suite_id": "01K5T8A2MZQ4VE6XCJ0RDBHW7N"
}

Path parameters

org_idstringRequired

Organization ID

workspace_idstringRequired

Workspace ID

test_suite_idstringRequired

Request

This endpoint expects an object.

namestringRequired1-255 characters

categorystringRequired1-255 characters

user_scenariostringRequired1-20000 characters

What the simulated user is trying to do.

expected_behaviorslist of objectsOptionalDefaults to []

Behaviors the agent is graded against.

variable_overrideslist of objectsOptionalDefaults to []

Suite variables overridden for this test case only.

max_turnsintegerOptional1-200Defaults to 50

Response

Successful Response

test_case_idstring

test_suite_idstring

Errors

401

Unauthorized Error

403

Forbidden Error

404

Not Found Error

422

Unprocessable Entity Error

429

Too Many Requests Error

Path parameters

Headers

Request

Response

Errors