Get test case results | Sarvam API Docs

import requests
url = "https://apps.sarvam.ai/api/evals/v1/org_id/workspace_id/test-suites/test_suite_id/runs/run_id/test-cases/test_case_id"
headers = {"X-API-Key": "<your-api-key>"}
response = requests.get(url, headers=headers)
print(response.json())

{
  "run_id": "01K5T9C4XR7NB2QJ5WD8HKTM0E",
  "test_case_id": "01K5T8B7PS3KD9GM1FYX4VQCJ2",
  "executions": [
    {
      "run_id": "01K5T9C4XR7NB2QJ5WD8HKTM0E",
      "test_suite_id": "01K5T8A2MZQ4VE6XCJ0RDBHW7N",
      "test_case_id": "01K5T8B7PS3KD9GM1FYX4VQCJ2",
      "test_case_name": "Caller reschedules to the weekend",
      "frequency_index": 0,
      "interaction_id": "01K5T9D8ZB4RF7HN2MJX6PWQC5",
      "transcript": [
        {
          "role": "assistant",
          "content": "Good morning, Sunrise Dental. How can I help you?"
        },
        {
          "role": "user",
          "content": "Hi, I have an appointment tomorrow but I need to move it to the weekend."
        },
        {
          "role": "assistant",
          "content": "Of course. Before I make any changes, may I have your full name and the phone number the booking is under?"
        },
        {
          "role": "user",
          "content": "Meera Sharma, 98xxxxxx21. Shanivaar ko koi slot hai kya?"
        },
        {
          "role": "assistant",
          "content": "Haan, Shanivaar ko do slot khule hain — subah 10:30 aur dopahar 3:00. Kaunsa theek rahega?"
        }
      ],
      "transcript_text": null,
      "evaluation_results": [
        {
          "name": "Offers concrete slots",
          "verdict": "Pass",
          "reasoning": "The agent proposed Saturday 10:30 and 15:00 rather than asking the caller to pick a time unprompted."
        },
        {
          "name": "Confirms the new booking",
          "verdict": "Pass",
          "reasoning": "The agent repeated the final slot and clinic name before closing."
        },
        {
          "name": "Guardrails",
          "verdict": "Pass",
          "reasoning": "Identity was verified before the booking changed and no medical advice was given."
        }
      ]
    },
    {
      "run_id": "01K5T9C4XR7NB2QJ5WD8HKTM0E",
      "test_suite_id": "01K5T8A2MZQ4VE6XCJ0RDBHW7N",
      "test_case_id": "01K5T8B7PS3KD9GM1FYX4VQCJ2",
      "test_case_name": "Caller reschedules to the weekend",
      "frequency_index": 1,
      "interaction_id": "01K5T9D8ZB4RF7HN2MJX6PWQC5",
      "transcript": [
        {
          "role": "assistant",
          "content": "Good morning, Sunrise Dental. How can I help you?"
        },
        {
          "role": "user",
          "content": "Hi, I have an appointment tomorrow but I need to move it to the weekend."
        },
        {
          "role": "assistant",
          "content": "Of course. Before I make any changes, may I have your full name and the phone number the booking is under?"
        },
        {
          "role": "user",
          "content": "Meera Sharma, 98xxxxxx21. Shanivaar ko koi slot hai kya?"
        },
        {
          "role": "assistant",
          "content": "Haan, Shanivaar ko do slot khule hain — subah 10:30 aur dopahar 3:00. Kaunsa theek rahega?"
        }
      ],
      "transcript_text": null,
      "evaluation_results": [
        {
          "name": "Offers concrete slots",
          "verdict": "Pass",
          "reasoning": "The agent proposed Saturday 10:30 and 15:00 rather than asking the caller to pick a time unprompted."
        },
        {
          "name": "Confirms the new booking",
          "verdict": "Pass",
          "reasoning": "The agent repeated the final slot and clinic name before closing."
        },
        {
          "name": "Guardrails",
          "verdict": "Pass",
          "reasoning": "Identity was verified before the booking changed and no medical advice was given."
        }
      ]
    }
  ]
}

One entry per execution, so a run with frequency above 1 returns that many. Includes the conversation transcript and the verdict for each expected behavior.

Path parameters

org_idstringRequired

Organization ID

workspace_idstringRequired

Workspace ID

test_suite_idstringRequired

run_idstringRequired

test_case_idstringRequired

Response

Successful Response

run_idstring

test_case_idstring

executionslist of objectsOptionalDefaults to []

Errors

401

Unauthorized Error

403

Forbidden Error

404

Not Found Error

422

Unprocessable Entity Error

429

Too Many Requests Error

Path parameters

Headers

Response

Errors