Benchmarks

Get Benchmark models.

get

https://api.probe.splx.aihttps://us.api.probe.splx.ai

/api/v2/benchmarks/models

Get all Benchmark models. If benchmarkTypeId is provided, it will return the scores calculated for that specific benchmark type. If not provided, it will return the total score aggregated across all benchmark types.

Authorizations

API Key

X-Api-KeystringRequired

API Key for authentication

Query parameters

benchmarkTypeIdinteger · int32Optional

Responses

200

OK

application/json

Benchmark model information including identification, provider details, and performance scores.

or

400

Bad Request

application/json

401

Unauthorized

application/json

403

Forbidden

application/json

500

Internal Server Error

application/json

get

/api/v2/benchmarks/models

HTTPcURLJavaScriptPython

GET /api/v2/benchmarks/models HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*

[
  {
    "id": 1,
    "name": "text",
    "provider": "text",
    "benchmarkDate": "2026-03-20T13:30:48.177Z",
    "url": "text",
    "scores": {
      "ANY_ADDITIONAL_PROPERTY": 1
    }
  }
]

Get Benchmark model details.

get

https://api.probe.splx.aihttps://us.api.probe.splx.ai

/api/v2/benchmarks/models/{modelId}

Get details of a specific Benchmark model. If benchmarkTypeId is provided, it will return the scores calculated for that specific benchmark type. If not provided, it will return the total score aggregated across all benchmark types.

Authorizations

API Key

X-Api-KeystringRequired

API Key for authentication

Path parameters

modelIdinteger · int64Required

Query parameters

benchmarkTypeIdinteger · int32Optional

Responses

200

OK

application/json

Benchmark model information including identification, provider details, and performance scores.

idinteger · int32Required

Unique identifier for the Benchmark model.

namestring · nullableRequired

Name of the Benchmark model.

providerstring · nullableRequired

Provider or organization that created/maintains the model.

benchmarkDatestring · date-time · nullableOptional

Date when the Benchmark was executed or last updated.

urlstring · nullableOptional

Optional URL providing additional information or documentation about the model.

descriptionstring · nullableOptional

Optional description providing detailed information about the Benchmark model.

totalCountinteger · int32Required

Total number of test cases executed during the Benchmark run.

passedCountinteger · int32Required

Number of test cases that passed during the Benchmark execution.

failedCountinteger · int32Required

Number of test cases that failed during the Benchmark execution.

400

Bad Request

application/json

401

Unauthorized

application/json

403

Forbidden

application/json

500

Internal Server Error

application/json

get

/api/v2/benchmarks/models/{modelId}

HTTPcURLJavaScriptPython

GET /api/v2/benchmarks/models/{modelId} HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*

{
  "id": 1,
  "name": "text",
  "provider": "text",
  "benchmarkDate": "2026-03-20T13:30:48.177Z",
  "url": "text",
  "scores": {
    "ANY_ADDITIONAL_PROPERTY": 1
  },
  "description": "text",
  "config": {
    "ANY_ADDITIONAL_PROPERTY": "anything"
  },
  "metadata": {
    "ANY_ADDITIONAL_PROPERTY": "anything"
  },
  "totalCount": 1,
  "passedCount": 1,
  "failedCount": 1,
  "ranks": {
    "ANY_ADDITIONAL_PROPERTY": 1
  }
}

Get Benchmark model probe runs.

get

https://api.probe.splx.aihttps://us.api.probe.splx.ai

/api/v2/benchmarks/models/{modelId}/runs

Get all probe runs for a specific benchmark model.

Authorizations

API Key

X-Api-KeystringRequired

API Key for authentication

Path parameters

modelIdinteger · int64Required

Query parameters

benchmarkTypeIdinteger · int32Required

Responses

200

OK

application/json

Benchmark probe run information including execution statistics, performance score, and probe identification.

or

or

400

Bad Request

application/json

401

Unauthorized

application/json

403

Forbidden

application/json

500

Internal Server Error

application/json

get

/api/v2/benchmarks/models/{modelId}/runs

HTTPcURLJavaScriptPython

GET /api/v2/benchmarks/models/{modelId}/runs?benchmarkTypeId=1 HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*

[
  {
    "id": 1,
    "passedCount": 1,
    "failedCount": 1,
    "totalCount": 1,
    "score": 1,
    "probeId": 1,
    "probeName": "text",
    "probeCategoryId": 1,
    "probeCategoryName": "text",
    "createdAt": "2026-03-20T13:30:48.177Z"
  }
]

Get details of a specific Benchmark probe run.

get

https://api.probe.splx.aihttps://us.api.probe.splx.ai

/api/v2/benchmarks/models/{modelId}/runs/{probeRunId}/test-cases

Retrieve detailed information about a specific Benchmark probe run by its unique identifier, including results, execution metadata and conversation.

Authorizations

API Key

X-Api-KeystringRequired

API Key for authentication

Path parameters

modelIdinteger · int64Required

probeRunIdinteger · int64Required

Responses

200

OK

application/json

Benchmark probe run information including execution statistics, performance score, and probe identification.

idinteger · int32Required

Unique identifier for the Benchmark probe run.

passedCountinteger · int32Required

Number of test cases that passed during the probe run.

failedCountinteger · int32Required

Number of test cases that failed during the probe run.

totalCountinteger · int32Required

Total number of test cases executed during the probe run.

scorenumber · floatRequired

Performance score calculated from the probe run results.

probeIdinteger · int32Required

Unique identifier of the probe that was executed.

probeNamestring · nullableRequired

Name of the probe that was executed.

probeCategoryIdinteger · int32Required

Unique identifier of the probe's category.

probeCategoryNamestring · nullableRequired

Name of the probe's category.

createdAtstring · date-timeRequired

Timestamp when the probe run was created and executed.

400

Bad Request

application/json

401

Unauthorized

application/json

403

Forbidden

application/json

500

Internal Server Error

application/json

get

/api/v2/benchmarks/models/{modelId}/runs/{probeRunId}/test-cases

HTTPcURLJavaScriptPython

GET /api/v2/benchmarks/models/{modelId}/runs/{probeRunId}/test-cases HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*

{
  "id": 1,
  "passedCount": 1,
  "failedCount": 1,
  "totalCount": 1,
  "score": 1,
  "probeId": 1,
  "probeName": "text",
  "probeCategoryId": 1,
  "probeCategoryName": "text",
  "createdAt": "2026-03-20T13:30:48.177Z",
  "results": [
    {
      "id": 1,
      "attackId": "text",
      "strategy": "text",
      "redTeamer": "text",
      "variation": "text",
      "status": "text",
      "redTeamerLabels": {
        "ANY_ADDITIONAL_PROPERTY": "text"
      },
      "createdAt": "2026-03-20T13:30:48.177Z",
      "conversation": [
        [
          {
            "role": "text",
            "messageContents": [
              {
                "text": "text",
                "encodedText": "text",
                "imageUrl": "text",
                "encodedImageUrl": "text",
                "contentType": "text",
                "audioUrl": "text",
                "encodedAudioUrl": "text",
                "documentUrl": "text",
                "encodedDocumentUrl": "text"
              }
            ]
          }
        ]
      ],
      "explanation": "text"
    }
  ]
}

Get all Benchmark types.

get

https://api.probe.splx.aihttps://us.api.probe.splx.ai

/api/v2/benchmarks/types

Retrieve all available Benchmark types.

Authorizations

API Key

X-Api-KeystringRequired

API Key for authentication

Responses

200

OK

application/json

Benchmark type information containing identification and description.

idinteger · int32Required

Unique identifier for the Benchmark type.

namestring · nullableRequired

Name of the Benchmark type.

descriptionstring · nullableOptional

Additional context about the Benchmark type.

400

Bad Request

application/json

401

Unauthorized

application/json

403

Forbidden

application/json

500

Internal Server Error

application/json

get

/api/v2/benchmarks/types

HTTPcURLJavaScriptPython

GET /api/v2/benchmarks/types HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*

[
  {
    "id": 1,
    "name": "text",
    "description": "text"
  }
]