EMS AIOps Success Measurement

AIOps Success Measurement ¶

Alert Handling Status Statistics ¶

- Number of alert accesses.
- Distribution of alert statuses (e.g., Firing, Pending, Resolved).
- Distribution of alert severities (Critical, Hign, Warning).
- Acknowledgment rate of alerts.

Alert Deduplication Efficiency ¶

- Reduction number of duplicate alerts.
- Ratio of deduplicated alerts to total alerts. ( reduction alerts / total alerts ) * 100%
- For each product, and record historical data to reflect trends.

Alert Correlation Efficiency ¶

- Number and ratio of correlated alerts. ( correlated alerts / total alerts ) * 100%
- Number of disassociated items and ratio to the total number. ( disassociated alerts / correlated alerts ) * 100%
- For each product, and record historical data to reflect trends.

Incident (P1/P2) Capture Rate ¶

- Ratio of the number of P1/P2 INC captured by EMS to all of those in SNOW.
- Summarized on daily / weekly basis, and record historical data to reflect trends.

Incident / Issue Adoption Rate ¶

- Number and ratio of incidents / issue automatically created that are adopted (not canceled).
- Summarized on daily / weekly basis, and record historical data to reflect trends.

Alert Resolve Time Differences ¶

- Trend of average resolve time of assigned alerts.

AI Usage Effectiveness ¶

- Number and ratio of AI RCA views and shares.
- Number and ratio of direct sync RCA to SNOW incident.
- Comparison of the resolve time of RCA-viewed alerts with the overall average resolve time.

Effectiveness on MTTR(recovery)/MTTD ¶

- Comparison of MTTR/MTTD of incidents (P1/P2) captured by EMS and other incidents.
- Comparison of the resolve time of RCA-viewed alerts with the overall average resolve time. - FY26Q2
- Comparison of MTTR/MTTD between EMS-generated incidents and other incidents.
- Record historical data to reflect trends.

Accuracy ¶

- The ratio of P1/P2 INC captured by EMS to all of those in SNOW. ( EMS captured INCs / total INCs ) * 100%
- The number and ratio of incidents / issue automatically created by EMS that are adopted (not canceled). ( not canceled INCs / total INCs ) * 100%