October 2024

New Target Integrations

We've expanded our integration options with:

• LLM:

  • Gemini

  • Bedrock

  • OpenAI Assistant

• LLM Development Platform:

  • Dify AI

Default Language Support

In addition to English, Probe can now test your target against attacks in the chatbot's default language. With support for over 60 languages, we provide more accurate and localized security assessments.

Q&A Probe

With Q&A Probe, you can test your application’s ability to respond correctly to questions you define. Probe will reformulate your questions, send them to your target, and check if the response content matches the correct answers you’ve set. Upload your question-answer combinations via CSV, provide a chatbot description, and let Probe handle the testing.

Jira Integration

You can now create Jira issues directly from the Probe's result page, with the autogenerated summary of your Probe run included in the issue. This makes it easier for your team to track any vulnerabilities found through automated red teaming.

Improvements & Tweaks

• Upload file option for easier Probe configurations (e.g., for RAG precision).

• Extended REST API integration with support for Open and Close Session endpoints.