Benchmarks

Get Benchmark models.

get

https://api.probe.splx.aihttps://us.api.probe.splx.ai

/api/v2/benchmarks/models

Get all Benchmark models. If benchmarkTypeId is provided, it will return the scores calculated for that specific benchmark type. If not provided, it will return the total score aggregated across all benchmark types.

Authorizations

API Key

X-Api-KeystringRequired

API Key for authentication

Query parameters

benchmarkTypeIdinteger · int32Optional

Responses

200

OK

application/json

400

Bad Request

application/json

401

Unauthorized

application/json

403

Forbidden

application/json

500

Internal Server Error

application/json

get

/api/v2/benchmarks/models

HTTPcURLJavaScriptPython

GET /api/v2/benchmarks/models HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*

[
  {
    "benchmarkDate": "2026-02-03T12:14:52.985Z",
    "id": 1,
    "name": "text",
    "provider": "text",
    "scores": {
      "ANY_ADDITIONAL_PROPERTY": 1
    },
    "url": "text"
  }
]

Get Benchmark model details.

get

https://api.probe.splx.aihttps://us.api.probe.splx.ai

/api/v2/benchmarks/models/{modelId}

Get details of a specific Benchmark model. If benchmarkTypeId is provided, it will return the scores calculated for that specific benchmark type. If not provided, it will return the total score aggregated across all benchmark types.

Authorizations

API Key

X-Api-KeystringRequired

API Key for authentication

Path parameters

modelIdinteger · int64Required

Query parameters

benchmarkTypeIdinteger · int32Optional

Responses

200

OK

application/json

400

Bad Request

application/json

401

Unauthorized

application/json

403

Forbidden

application/json

500

Internal Server Error

application/json

get

/api/v2/benchmarks/models/{modelId}

HTTPcURLJavaScriptPython

GET /api/v2/benchmarks/models/{modelId} HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*

{
  "config": {
    "ANY_ADDITIONAL_PROPERTY": "anything"
  },
  "description": "text",
  "failedCount": 1,
  "metadata": {
    "ANY_ADDITIONAL_PROPERTY": "anything"
  },
  "passedCount": 1,
  "ranks": {
    "ANY_ADDITIONAL_PROPERTY": 1
  },
  "totalCount": 1,
  "benchmarkDate": "2026-02-03T12:14:52.985Z",
  "id": 1,
  "name": "text",
  "provider": "text",
  "scores": {
    "ANY_ADDITIONAL_PROPERTY": 1
  },
  "url": "text"
}

Get Benchmark model probe runs.

get

https://api.probe.splx.aihttps://us.api.probe.splx.ai

/api/v2/benchmarks/models/{modelId}/runs

Get all probe runs for a specific benchmark model.

Authorizations

API Key

X-Api-KeystringRequired

API Key for authentication

Path parameters

modelIdinteger · int64Required

Query parameters

benchmarkTypeIdinteger · int32Required

Responses

200

OK

application/json

400

Bad Request

application/json

401

Unauthorized

application/json

403

Forbidden

application/json

500

Internal Server Error

application/json

get

/api/v2/benchmarks/models/{modelId}/runs

HTTPcURLJavaScriptPython

GET /api/v2/benchmarks/models/{modelId}/runs?benchmarkTypeId=1 HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*

[
  {
    "createdAt": "2026-02-03T12:14:52.985Z",
    "failedCount": 1,
    "id": 1,
    "passedCount": 1,
    "probeCategoryId": 1,
    "probeCategoryName": "text",
    "probeId": 1,
    "probeName": "text",
    "score": 1,
    "totalCount": 1
  }
]

Get details of a specific Benchmark probe run.

get

https://api.probe.splx.aihttps://us.api.probe.splx.ai

/api/v2/benchmarks/models/{modelId}/runs/{probeRunId}/test-cases

Retrieve detailed information about a specific Benchmark probe run by its unique identifier, including results, execution metadata and conversation.

Authorizations

API Key

X-Api-KeystringRequired

API Key for authentication

Path parameters

modelIdinteger · int64Required

probeRunIdinteger · int64Required

Responses

200

OK

application/json

400

Bad Request

application/json

401

Unauthorized

application/json

403

Forbidden

application/json

500

Internal Server Error

application/json

get

/api/v2/benchmarks/models/{modelId}/runs/{probeRunId}/test-cases

HTTPcURLJavaScriptPython

GET /api/v2/benchmarks/models/{modelId}/runs/{probeRunId}/test-cases HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*

{
  "results": [
    {
      "attackId": "text",
      "conversation": [
        [
          {
            "messageContents": [
              {
                "audioUrl": "text",
                "contentType": "text",
                "documentUrl": "text",
                "encodedAudioUrl": "text",
                "encodedDocumentUrl": "text",
                "encodedImageUrl": "text",
                "encodedText": "text",
                "imageUrl": "text",
                "text": "text"
              }
            ],
            "role": "text"
          }
        ]
      ],
      "createdAt": "2026-02-03T12:14:52.985Z",
      "explanation": "text",
      "id": 1,
      "redTeamer": "text",
      "redTeamerLabels": {
        "ANY_ADDITIONAL_PROPERTY": "text"
      },
      "status": "text",
      "strategy": "text",
      "variation": "text"
    }
  ],
  "createdAt": "2026-02-03T12:14:52.985Z",
  "failedCount": 1,
  "id": 1,
  "passedCount": 1,
  "probeCategoryId": 1,
  "probeCategoryName": "text",
  "probeId": 1,
  "probeName": "text",
  "score": 1,
  "totalCount": 1
}

Get all Benchmark types.

get

https://api.probe.splx.aihttps://us.api.probe.splx.ai

/api/v2/benchmarks/types

Retrieve all available Benchmark types.

Authorizations

API Key

X-Api-KeystringRequired

API Key for authentication

Responses

200

OK

application/json

400

Bad Request

application/json

401

Unauthorized

application/json

403

Forbidden

application/json

500

Internal Server Error

application/json

get

/api/v2/benchmarks/types

HTTPcURLJavaScriptPython

GET /api/v2/benchmarks/types HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*

[
  {
    "description": "text",
    "id": 1,
    "name": "text"
  }
]