Business Alignment
Business Alignment probes test whether a target follows your organization’s business rules and brand guardrails. They simulate prompts that pressure the target into out-of-scope or high-stakes behavior.
They mark results as pass/fail based on adherence to internal policies and intended use cases.
These probes help you assess:
Adherence to company policies, disclaimers, and approved messaging.
Brand voice, tone, and style consistency.
Handling of out-of-scope requests and escalation paths.
Prevention of unauthorized commitments (e.g., refunds, contracts, unlisted services).
Competitor Check
Use this probe to test whether the target handles mentions of competitors appropriately. It evaluates whether the target avoids redirecting users or favoring competitor services.
Probe ID: 8
Supported Modes: Text, Document
What to Expect
The probe simulates prompts asking about:
Competitor services, websites, or resources.
Comparisons between your company and competitors.
Why It Matters
Incorrect handling could divert potential customers to competitors, causing revenue loss and harming business interests.
Configuration Inputs
Company Name - Enter the name of the company that owns the target application.
Company Services - List the main services or products your company provides. This helps the probe craft realistic prompts tied to your business context (e.g., “online banking,” “car repair,” “SaaS analytics”).
Competitor List - Add the names of your competitors. The probe will use these to test whether the target mentions them appropriately or gives them undue attention.
Intentional Misuse
Use this probe to test whether the target can be manipulated for unintended purposes. It evaluates how the target responds when users attempt to exploit it for personal gain or advantage.
Probe ID: 12
Supported Modes: Text, Image, Voice, Document
What to Expect
The probe simulates prompts designed to see if the target:
Performs actions outside its intended scope.
Responds in ways that could strain resources or cause harm.
Why It Matters
If the target can be misused, it may lead to financial loss, denial of service, or security risks through unintended and potentially harmful responses.
Configuration Inputs
Company Name - Enter the name of the company that owns the target application.
Legally Binding
Use this probe to test whether the target can be manipulated into making high-stakes decisions with legal or financial consequences. It evaluates if the target enforces proper authorization protocols.
Probe ID: 44
Supported Modes: Text, Document
What to Expect
The probe simulates prompts that try to make the target:
Approve refunds or discounts.
Initiate or confirm contracts.
Provide unlisted services without proper authorization.
Why It Matters
If the target is exploited, it can create legal liability, financial losses, and reputational damage. This probe ensures safeguards prevent unauthorized commitments.
Off Topic
Use this probe to test whether the target stays focused and relevant during interactions. It evaluates the target’s ability to handle questions that could lead it away from its intended purpose.
Probe ID: 13
Supported Modes: Text, Image, Voice, Document
What to Expect
The probe simulates prompts that try to make the target:
Deviate from the main topic.
Engage in discussions about sensitive subjects that may provoke strong opinions.
Why It Matters
If the target goes off-topic, it can frustrate users, reduce engagement, and lead to a poor overall experience.
Last updated
Was this helpful?