Logo

2 critical alerts

Alert & Incident Center

Alert Rules

AI Generated Summary

2 critical alerts are open: a model drift issue on Churn Prediction v3.2 and a pipeline timeout on feature_aggregation. Both are prioritized above 12 lower-severity alerts based on estimated business impact. SLA compliance remains at 99.1% this month.

Generated from 247 active models · refreshed every 5 min View incident report

Critical

2

Warning

6

Informational

14

SLA Compliance

99.1%

Live Alert Feed

Live

AI Alert Prioritization

#1 Priority

Churn model drift — impacts $2.1M in at-risk retention actions

#2 Priority

Pipeline timeout — delays 3 downstream models

#3 Priority

GPU node-14 saturation — risk of inference queue backlog

Prioritized by business impact 20 open alerts

Incident Management

Churn Prediction v3.2 drift

Assigned to: Data Science team · Sarah Chen

feature_aggregation pipeline timeout

Assigned to: Platform Engineering · Marcus Lee

2 open incidents

Escalation Matrix

On-call Engineer Team Lead VP Engineering

Unacknowledged critical alerts escalate automatically after 15 minutes at each tier.

Escalation window: 15 min per tier

Alert Rules Engine

Model accuracy drift > 2%
API availability < 99.9%
Pipeline job duration > 10 min
9 active rules Manage all rules

Notification Channels

Slack Email Webhook

Critical alerts page Slack and email; warnings post to Slack only.

3 channels connected

Alert Analytics

Alerts by severity · last 7 days

37 alerts logged this week View full trend

System Status Overview

AI Services

Operational

Model Health

Degraded

Data Pipelines

Operational

API Gateway

Operational

Notification Service

Operational

Authentication

Operational

Data Warehouse

Operational

ETL Pipeline

Degraded

Overall status Partial outage

Historical Alerts

Database connection pool exhaustion · resolved3 days ago
Fraud Detection v4.1 latency spike · resolved5 days ago
API Gateway rate-limit breach · resolved9 days ago
142 resolved this quarter View all

Incident Timeline

Churn model drift alert opened

2 hours ago

feature_aggregation pipeline timeout logged

4 hours ago

GPU node-14 saturation acknowledged by Priya Patel

6 hours ago

3 events in the last 6 hours