October 2024
New Target Integrations
We've expanded our integration options with:
LLM:
Gemini
Bedrock
OpenAI Assistant
LLM Development Platform:
Dify AI
Default Language Support
In addition to English, Probe can now test your target against attacks in the chatbot's default language. With support for over 60 languages, we provide more accurate and localized security assessments.
Q&A Probe
With Q&A Probe, you can test your application’s ability to respond correctly to questions you define. Probe will reformulate your questions, send them to your target, and check if the response content matches the correct answers you’ve set. Upload your question-answer combinations via CSV, provide a chatbot description, and let Probe handle the testing.
Jira Integration
You can now create Jira issues directly from the Probe's result page, with the autogenerated summary of your Probe run included in the issue. This makes it easier for your team to track any vulnerabilities found through automated red teaming.
Improvements & Tweaks
Upload file option for easier Probe configurations (e.g., for RAG precision).
Extended REST API integration with support for Open and Close Session endpoints.
Last updated