May 2025

Overview Page Redesign

We've redesigned the Overview page to deliver a better user experience and support our new Performance Scores, which replace the previous Risk Score. The updated scoring system now evaluates performance at the category level and overall, offering deeper insight into the state of your application. Learn more about the new Overview page on its dedicated documentation page.

New Probe Categories

We've redesigned how probes are categorized to provide a clearer view of your application's performance. Probes are now grouped into the following categories:

• Security

• Safety

• Hallucination & Trustworthiness

• Business Alignment

• Custom

These new groupings help users better assess different aspects of their application's risk and reliability on the Overview page.

Databricks Connection

Users can now seamlessly connect and test their Databricks models within the platform. For setup details, visit the Databricks Connection page.

Improvements & Tweaks

• Centralized Configuration: Fields that were previously duplicated across different probe configurations have been moved to Target Configuration for consistency. This includes:

  • System Prompt type (Confidential, Not Confidential, Raw Tools/Functions)

  • RAG Files

• Tag Support: Tags are now be added next to probe names (e.g., Deprecated).

• Predefined Responses: Added support for predefined responses in Target Configuration. This allows users to define expected predefined target replies, useful for handling blocked messages with guardrail responses.

• Improved Login Flow: The login process has been updated so users can change email address without needing to refresh the login page.