Notifications
Notifications report evaluation run and AI judging outcomes to a messaging platform. A provider connects to a platform, such as a slack workspace, and a subscription routes one evaluation, or every evaluation, to one destination on that provider, such as a slack channel.
List notification providers
Lists every configured connection. Credentials are never returned; a has_ boolean
Create notification provider
Creates a connection to a messaging platform. The credential is verified with the platform
Delete notification providers
Deletes the connections for the given unique identifiers, along with the subscriptions
Get notification provider
Gets a connection by its unique identifier.
Update notification provider
Updates a connection. For credential fields, omitting the field or sending null keeps the
List Slack channels
Lists the channels the connected Slack app can see, for choosing where a subscription
List notification subscriptions
Lists every notification subscription. A subscription with no evaluation_id covers every evaluation.
Create notification subscription
Creates a route. Omit evaluation_id to notify for every evaluation. The same
Delete notification subscriptions
Deletes the routes for the given unique identifiers. The providers they route through are
Get notification subscription
Gets a route by its unique identifier.
Update notification subscription
Updates a route's destination, scope, and the outcomes it reports. A subscription cannot be
Test notification
Delivers a sample message to the subscription's destination so the connection, the channel,