Benchmarks

Get Benchmark models.

get
/api/v2/benchmarks/models

Get all Benchmark models. If benchmarkTypeId is provided, it will return the scores calculated for that specific benchmark type. If not provided, it will return the total score aggregated across all benchmark types.

Authorizations
X-Api-KeystringRequired

API Key for authentication

Query parameters
benchmarkTypeIdinteger · int32Optional
Responses
200

OK

application/json
get
/api/v2/benchmarks/models
GET /api/v2/benchmarks/models HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*
[
  {
    "benchmarkDate": "2025-12-06T17:26:26.262Z",
    "id": 1,
    "name": "text",
    "provider": "text",
    "scores": {
      "ANY_ADDITIONAL_PROPERTY": 1
    },
    "url": "text"
  }
]

Get Benchmark model details.

get
/api/v2/benchmarks/models/{modelId}

Get details of a specific Benchmark model. If benchmarkTypeId is provided, it will return the scores calculated for that specific benchmark type. If not provided, it will return the total score aggregated across all benchmark types.

Authorizations
X-Api-KeystringRequired

API Key for authentication

Path parameters
modelIdinteger · int64Required
Query parameters
benchmarkTypeIdinteger · int32Optional
Responses
200

OK

application/json
get
/api/v2/benchmarks/models/{modelId}
GET /api/v2/benchmarks/models/{modelId} HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*
{
  "config": {
    "ANY_ADDITIONAL_PROPERTY": "anything"
  },
  "description": "text",
  "failedCount": 1,
  "metadata": {
    "ANY_ADDITIONAL_PROPERTY": "anything"
  },
  "passedCount": 1,
  "ranks": {
    "ANY_ADDITIONAL_PROPERTY": 1
  },
  "totalCount": 1,
  "benchmarkDate": "2025-12-06T17:26:26.262Z",
  "id": 1,
  "name": "text",
  "provider": "text",
  "scores": {
    "ANY_ADDITIONAL_PROPERTY": 1
  },
  "url": "text"
}

Get Benchmark model probe runs.

get
/api/v2/benchmarks/models/{modelId}/runs

Get all probe runs for a specific benchmark model.

Authorizations
X-Api-KeystringRequired

API Key for authentication

Path parameters
modelIdinteger · int64Required
Query parameters
benchmarkTypeIdinteger · int32Required
Responses
200

OK

application/json
get
/api/v2/benchmarks/models/{modelId}/runs
GET /api/v2/benchmarks/models/{modelId}/runs?benchmarkTypeId=1 HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*
[
  {
    "createdAt": "2025-12-06T17:26:26.262Z",
    "failedCount": 1,
    "id": 1,
    "passedCount": 1,
    "probeCategoryId": 1,
    "probeCategoryName": "text",
    "probeId": 1,
    "probeName": "text",
    "score": 1,
    "totalCount": 1
  }
]

Get details of a specific Benchmark probe run.

get
/api/v2/benchmarks/models/{modelId}/runs/{probeRunId}/test-cases

Retrieve detailed information about a specific Benchmark probe run by its unique identifier, including results, execution metadata and conversation.

Authorizations
X-Api-KeystringRequired

API Key for authentication

Path parameters
modelIdinteger · int64Required
probeRunIdinteger · int64Required
Responses
200

OK

application/json
get
/api/v2/benchmarks/models/{modelId}/runs/{probeRunId}/test-cases
GET /api/v2/benchmarks/models/{modelId}/runs/{probeRunId}/test-cases HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*
{
  "results": [
    {
      "attackId": "text",
      "conversation": [
        [
          {
            "messageContents": [
              {
                "audioUrl": "text",
                "contentType": "text",
                "documentUrl": "text",
                "encodedAudioUrl": "text",
                "encodedDocumentUrl": "text",
                "encodedImageUrl": "text",
                "encodedText": "text",
                "imageUrl": "text",
                "text": "text"
              }
            ],
            "role": "text"
          }
        ]
      ],
      "createdAt": "2025-12-06T17:26:26.262Z",
      "explanation": "text",
      "id": 1,
      "redTeamer": "text",
      "redTeamerLabels": {
        "ANY_ADDITIONAL_PROPERTY": "text"
      },
      "status": "text",
      "strategy": "text",
      "variation": "text"
    }
  ],
  "createdAt": "2025-12-06T17:26:26.262Z",
  "failedCount": 1,
  "id": 1,
  "passedCount": 1,
  "probeCategoryId": 1,
  "probeCategoryName": "text",
  "probeId": 1,
  "probeName": "text",
  "score": 1,
  "totalCount": 1
}

Get all Benchmark types.

get
/api/v2/benchmarks/types

Retrieve all available Benchmark types.

Authorizations
X-Api-KeystringRequired

API Key for authentication

Responses
200

OK

application/json
get
/api/v2/benchmarks/types
GET /api/v2/benchmarks/types HTTP/1.1
Host: api.probe.splx.ai
X-Api-Key: YOUR_API_KEY
Accept: */*
[
  {
    "description": "text",
    "id": 1,
    "name": "text"
  }
]

Last updated