Comparing Apples and Volkswagens: The Problem With Aggregate Incident Metrics

QCon New York 2023

Session Resilience

Comparing Apples and Volkswagens: The Problem With Aggregate Incident Metrics

Thursday Jun 15 / 11:50AM EDT, Salon E

Abstract

This talk presents data from the Verica Open Incident Database (VOID) to conclusively demonstrate how aggregate incident metrics (MTTR, severity, # of incidents/time) aren't representative of your systems' resilience. I then pair those data with observations from actual incident reports of what kind of useful information can be gleaned from incident analysis, and suggest alternate things you can measure instead in order to demonstrate learning from incidents in your organization.

Topics

Resilience Learning From Incidents SRE
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon New York 2023 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Thursday 15 June

10:35 Salon E Session Two Years of Incidents at 6 Different Companies: How a Culture of Resilience Can Help You Accomplish Your Goals Vanessa Huerta Granda Solutions Engineer @Jeli.io 11:50 Salon E Session Resilience Comparing Apples and Volkswagens: The Problem With Aggregate Incident Metrics Courtney Nash Internet Incident Librarian & Senior Research Analyst at Verica, previously @Holloway @Fastly @O’Reilly Media @Microsoft & @Amazon 13:40 Williamsburg / Greenpoint Session Resilience Engineering Resilience Hides in Plain Sight John Allspaw Founder and Principal @Adaptive Capacity Labs 14:55 Salon E Session Resilience Engineering Embrace Complexity; Tighten Your Feedback Loops Fred Hebert Staff SRE @Honeycombio 16:10 Salon E Session Resilience Engineering 5 Strategies to Resiliently Handle Uncertainty, Time Pressure & Change Dr. Laura Maguire Cognitive Systems Engineer & Researcher