Model Performance

ML model accuracy and monitoring

Overall Health

Healthy

All models within thresholds

Days Since Drift Alert

3

Last: 23 Mar 2026

Drift Alerts (30d)

4

2 warning, 2 info

Next Scheduled Retrain

31 Mar

In 5 days (bi-weekly)

Data Quality Score

96.2%

Missing: 1.8% | Outliers: 2.0%

Prediction Volume (7d)

2,841

+12.3% vs previous week

Retrain Recommendation Engine
Automated model health assessment
Lead Conversion39d ago
Retrain Recommended
Recommendation Confidence78%
Feature Drift (PSI)weight: 0.35

2 features above 0.10 threshold (income: 0.14, region: 0.19)

Performance Decayweight: 0.30

AUC dropped from 0.87 to 0.85 on recent validation set

Data Volumeweight: 0.15

3,200 new labeled samples since last training

Time Since Trainingweight: 0.10

39 days (threshold: 30 days)

Prediction Confidenceweight: 0.10

Average confidence: 0.81 (stable)

Estimated improvement: +1.5-2.0% AUC
Customer Value44d ago
No Retrain Needed
Recommendation Confidence92%
Feature Drift (PSI)weight: 0.35

All features below 0.10 threshold

Performance Decayweight: 0.30

R² stable at 0.82 on recent validation set

Data Volumeweight: 0.15

2,100 new labeled samples since last training

Time Since Trainingweight: 0.10

44 days (threshold: 30 days)

Prediction Confidenceweight: 0.10

Average confidence: 0.84 (stable)

Estimated improvement: +0.3-0.5% R²
Overall Drift Score
Aggregated PSI over time
Data Quality Trend
Input data health over time
Feature Drift Heatmap
Population Stability Index (PSI) per feature
Stable (<0.05)
Low (0.05-0.10)
Warning (0.10-0.20)
Critical (>0.20)
FeatureW1 FebW2 FebW3 FebW4 FebW1 MarW2 MarW3 MarW4 MarLatest
income
0.02
0.03
0.04
0.03
0.05
0.08
0.12
0.14
Warning
age_category
0.01
0.01
0.02
0.02
0.03
0.03
0.04
0.04
Stable
region
0.03
0.05
0.07
0.11
0.15
0.18
0.22
0.19
Warning
touchpoint_count
0.01
0.02
0.01
0.02
0.03
0.02
0.03
0.03
Stable
campaign_response
0.02
0.03
0.05
0.06
0.08
0.10
0.11
0.09
Low
gender
0.00
0.01
0.01
0.01
0.01
0.02
0.02
0.01
Stable
days_since_creation
0.04
0.05
0.06
0.08
0.09
0.11
0.13
0.10
Warning
channel_diversity
0.01
0.01
0.02
0.02
0.03
0.03
0.04
0.05
Low

PSI (Population Stability Index) measures distribution shift between training and production data. Values above 0.10 suggest notable drift — features income and region show increasing drift and may need attention.

Prediction Distribution Shift
Comparing training baseline vs. current production output

Lead score bins — notable right-shift in production scores (higher scores more frequent)

Drift Monitor
Recent metric changes
Lead Conversion
25 Feb 2026

AUC improved after latest retraining

AUC: 0.86 → 0.87
Customer Value
18 Feb 2026

MAPE increased slightly — monitor for further drift

MAPE: 7.9 → 8.7
Lead Conversion
10 Feb 2026

Precision improved after feature engineering update

Precision: 0.79 → 0.81
Customer Value
28 Jan 2026

R² improved after adding new customer segments

R²: 0.80 → 0.82
Lead Conversion
15 Jan 2026

Recall dropped — retraining recommended

Recall: 0.80 → 0.76
Retraining History
ModelDateSamplesDurationMetric ChangeTriggerStatus
Lead Conversion
15/02/2026, 09:0015,20012m 34sAUC: 0.86 → 0.87 ↑
Scheduled
OK
Customer Value
10/02/2026, 11:3012,80018m 12sR²: 0.80 → 0.82 ↑
Manual
OK
Lead Conversion
20/01/2026, 10:0014,50011m 45sAUC: 0.85 → 0.86 ↑
Drift Alert
OK
Customer Value
05/01/2026, 14:0011,20016m 08sR²: 0.78 → 0.80 ↑
Scheduled
OK
Lead Conversion
15/12/2025, 09:3013,80013m 22sAUC: 0.84 → 0.85 ↑
Scheduled
OK
Customer Value
01/12/2025, 10:0010,5000m 00s—
Manual
Failed