Cybersecurity Case Study · Detect & Respond

Security KPI & Metrics Analysis

This project defines ten cybersecurity key performance indicators and applies each one to a publicly reported 2026 security incident. Five are common security-operations measures such as MTTD and MTTR, and five extend measurement into asset visibility, logging, allowlisting, configuration, and penetration-testing coverage.

By Sean Richard · Project date August 2026

At a glance

Scope
Ten KPIs: five security-operations measures, and five extending into asset visibility, logging, allowlisting, configuration, and penetration-testing coverage.
Method
For each KPI: a definition and its real-world use, a 2026 incident from public reporting, and how the metric would have measured or improved the response.
Sources
Fortinet, Atlassian, and Bitsight KPI glossaries, and the CIS Controls Assessment Specification. Incidents are cited from public reporting, mainly TechCrunch.

Why security KPIs need a real incident next to them

A metric is only useful if someone can say what decision it changes. The project therefore pairs every KPI with an incident that was publicly reported in 2026 and asks what the number would have measured, or what it would have exposed earlier. Each entry has the same three parts: an explanation and real-world use, the cited case, and how the KPI applies.

The ten KPIs and the incidents they were applied to

Ten cybersecurity KPIs, what each measures, and the publicly reported incident it was applied to
KPIWhat it measuresApplied to (as publicly reported)
1. Mean Time to Detect (MTTD)Average time between the start of an incident and its detection.Hugging Face breach, July 2026
2. Mean Time to Resolve (MTTR)Average time to fully resolve an incident, including diagnosis, repair, and restoration.Stryker network disruption, March 2026
3. Patching CadenceHow quickly security patches are deployed, and the share of critical patches completed within the required service level.ServiceNow data-exposure bug, June 2026
4. Access ManagementWhether users, service accounts, vendors, and administrators hold only the access they need.Klue legacy-credential breach, June 2026
5. Average Vendor Security RatingA consistent quantitative rating of third-party security posture, tracked over time.LastPass exposure through Klue, June 2026
6. Software Inventory Tool CoveragePercentage of applicable endpoints visible to automated software inventory tools.Fortinet firewall campaign, June 2026
7. Audit Log CoveragePercentage of systems and service providers configured to collect the required logs.Hugging Face breach, July 2026
8. Application Allowlisting Installation CoveragePercentage of capable assets that have an allowlisting control installed.2026 open-source supply-chain compromises
9. Standard Configuration CoveragePercentage of authorized software or systems with documented, maintained secure configuration standards.Klaviyo sign-up form misconfiguration, August 2026
10. Unauthenticated Penetration Testing CoveragePercentage of applications that have received unauthenticated penetration testing.ServiceNow data-exposure bug, June 2026

MTTD and MTTR: measuring detection and response

Mean Time to Detect is calculated from incident start and detection timestamps and reviewed by severity, business unit, or detection source. A falling MTTD indicates that monitoring, alerting, and analyst workflows are finding threats faster. A rising MTTD can reveal gaps in logging, detection rules, staffing, or visibility that let attackers stay active longer. Applied to the reported Hugging Face incident, MTTD would measure the elapsed time between the first malicious action and the first confirmed detection, and tracking it across incidents would show whether new detection rules and logging improvements are reducing attacker dwell time.

Mean Time to Resolve adds total resolution time for incidents in a period and divides by the number of incidents. Applied to the reported Stryker disruption, the analysis recommends measuring MTTR for each affected business service instead of treating recovery as a single event. Comparing those results identifies which systems were restored efficiently and which recovery processes need work before the next major incident.

Coverage metrics: finding the blind spots

KPIs 6 through 10 come from the CIS Controls Assessment Specification and share one idea: measure how much of the environment a control actually reaches, instead of assuming a policy or a tool purchase protects everything.

  • Software inventory coverage would not stop a credential attack by itself, but complete visibility lets a team find every affected device, its software, and its owner quickly, so remediation is not slowed by forgotten assets.
  • Audit log coverage turns missing telemetry into known investigation gaps. High coverage supports faster detection, stronger forensic analysis, and more reliable lessons learned.
  • Allowlisting coverage shows whether the control is really installed across eligible systems. The analysis notes it does not remove trusted software supply-chain risk and should be combined with integrity checks, monitoring, and vendor controls.
  • Standard configuration coverage reduces dependence on individual administrator choices, and automated configuration testing can verify that requirements survive website or tracking changes.
  • Unauthenticated penetration testing coverage confirms the external attack surface is tested consistently. Findings still need their own remediation metrics.

Access and vendor risk metrics

The access management entry centers on a reported case in which a credential issued to a third party for a limited pilot in 2022 remained usable years later. Useful measures include the age of third-party credentials, the percentage of vendor accounts reviewed on schedule, and the number of credentials with no current business owner. The vendor rating entry makes the companion point: third-party risk has to be measured beyond the internal network. A rating should not replace a full vendor risk assessment, but it helps prioritize attention across a large vendor population and communicate that risk to management.

What this project demonstrates

  • Defining security KPIs precisely, including how each one is calculated.
  • Connecting a metric to the operational decision it should change.
  • Using coverage metrics from the CIS Controls Assessment Specification to find blind spots.
  • Stating the limits of each metric instead of overselling it.
Security metricsMTTD/MTTRPatchingVendor riskLoggingAsset visibilityPenetration testing

Read the full document

Portfolio edition of coursework completed for the B.S. in Cyber/Computer Forensics & Counterterrorism at Full Sail University. The organization and scenario are a course case study, and this page summarizes the full document.

Related work

Ready to build the system behind your growth?

Tell me what you're operating.