Probe Configuration

After connecting your target to the Probe and configuring it, you can enable the probes that will be executed against your application to identify vulnerabilities (Figure 1).

Figure 1: Probe Configuration Tab

Each probe is specifically designed to provoke and detect a particular vulnerability. Probes are divided into four major categories.

Probe Categories

Prompt Injection

Prompt Injection attacks generative AI systems by manipulating the input prompts to alter the chatbot's behavior. The objectives of these attacks may include:

• Leaking sensitive data

• Spreading misinformation

• Causing other forms of harm

Off-Topic

Off-Topic probes assess a language model's tendency to deviate from its intended function or context. These Probes evaluate the model’s ability to stay on its intended topic and avoid irrelevant responses. By analyzing responses to off-topic prompts, you can:

• Gain insights into the model’s behavior.

• Identify areas for system prompt's improvement.

Hallucination

Hallucination probes test the limits of a generative AI model by encouraging it to produce fictional, nonsensical, or inaccurate information. These tests help you assess:

• The model’s trustworthiness.

• Robustness.

• Adherence to factual accuracy.

Social Engineering

Social Engineering probes evaluate a generative AI application's vulnerability to manipulative prompts designed to exploit trust or extract sensitive information. These probes help you assess:

• The applications's susceptibility to manipulation.

• Its ability to recognize and resist malicious or deceptive inputs.

• Potential risks to user safety and data security.

Enabling a Probe

Beside each probe, there is a toggle button that enables it. The toggle opens a optimization dialog with input fields that help you tailor the probe to your application's needs, making it domain-specific and enhancing the relevance and realism of the simulated attacks (Figure 2).

The example of the probe's optimization can be seen in the provided example.

Figure 3: Probe Optimization Dialog

Competitor Check Optimization Explained

• Company Name

  • Enter the name of your company.

• Services

  • List the products and services that your company offers.

• Competitor List

  • Provide a list of competitors against which you want to test your application. The Competitor Check will attempt to convince your application to recommend or mention the competitors.

• Additional Information

  • You can use this field to add any additional information about your products that might be relevant for the probe.

Clicking the "Save and Enable Probe" button stores the probe configuration and enables the probe on the given target.

Probe Details

To view the information about each probe, click the "Details" button on the right side. You can see how the modal looks in the documentation of the Probe Catalog page, from which you can also access the probe details.

Saving Changes

After connecting the target to the Probe platform and selecting and configuring at least one of the available probes, you can save the new target by clicking the "Save" button.

A success notification will indicate that your new target has been saved successfully. Your target will be automatically selected, and its name will appear in the targets list within the drop-down menu. An empty Overview page will be displayed, allowing you to start your first test run.

For assistance with your first test run, please visit the Test Run page.

Any additional changes to the existing target or probe configurations can be made through the Target Settings page.