Logo

54 pipelines running

Pipeline Command Center

AI Generated Summary

54 pipelines are running with 3 currently failing due to a schema change in the customer_events source. Average processing throughput is up 8% after last week's ETL consolidation.

Confidence 95.6% · generated 5 min ago

Pipeline Flow Visualization

Sources

Transform

3 failing

Warehouse

Models

4 stages · 54 active pipelines 3 stuck at Transform

Running

54

Scheduled

28

Failed

3

Queue Depth

1,240

Dependency Graph

customer_eventsfeature_aggregationchurn_model
transactionsrevenue_rollupforecast_model
product_cataloginventory_syncrecommendation_model
support_ticketssentiment_scoringchurn_model
model_predictionsaccuracy_scoringmodel_health
product_catalogfeature_enrichmentrecommendation_model
12 dependency chains tracked No cycles detected

Processing Throughput

Records per minute · last 24 hours

Workflow Scheduler

Scheduled pipeline windows · next 6 hours

Pipeline Performance Analytics

Success rate by pipeline

Resource Consumption

Compute allocation across pipelines

Retry Center

feature_aggregation · schema mismatch
inventory_sync · source timeout
sentiment_scoring · rate limited
3 pipelines queued for retry

AI Optimization

Merge revenue_rollup and forecast_prep into a single job to reduce redundant reads by an estimated 18%.
Partition customer_events by region before the transform stage to avoid the recurring schema-drift failures.
Estimated savings if applied 18% fewer redundant reads

Pipeline History

customer_events completed · 2.1M rows10m ago
revenue_rollup completed · 640K rows22m ago
inventory_sync completed · 1.4M rows38m ago
Runs completed today 51 of 54

Event Timeline

feature_aggregation failed · schema mismatch

30 min ago

churn_model retrained on refreshed feature set

2 hours ago

Events in last 24 hours 86 events