Dark Patterns in Vulnerability Management: How Metrics Undermine Real Security

Vulnerability management programs often fail not due to lack of scanners but because of poorly chosen metrics that prioritize reporting over actual risk reduction. Teams focus on closing easy vulnerabilities, meeting CVSS-based deadlines, and improving dashboard numbers while attackers exploit the shortest path to critical assets. The article examines five common traps including total vulnerability counts, context-free SLAs, closure rate targets, static dashboards, and claims of no critical findings. It argues that these metrics create a false sense of security and distort team behavior according to Goodhart's Law. Instead, organizations should adopt attack path metrics, exposure management approaches such as CTEM, and measurements that track real reduction in attacker reachability. The piece highlights MaxPatrol Carbon as an example of tools that model attacker paths rather than isolated CVEs.

SecuritylabTranslated from Russian

Read at source

Vulnerability management rarely collapses because of insufficient scanners. Far more often the process is broken by the metrics teams report to leadership. While specialists argue over priorities, close tickets, and present attractive trends, attackers look for the shortest route to important systems. In this situation a dashboard does not protect; it reassures.

This is the central paradox of vulnerability management. The process can be formally mature, heavily automated, and expensive yet still fail to answer the only truly important question: how difficult is it right now for an attacker to reach critical assets. When metrics replace risk, security begins to serve reporting instead of protection.

Where vulnerability management actually breaks

The classic workflow appears logical: discover assets, scan infrastructure, collect vulnerability data, prioritize, remediate, and verify. On paper everything looks sound. In practice the process quickly comes under pressure from management logic. Business needs clear numbers, executives need visible progress, and IT teams need deadlines and success criteria. At this point metrics appear that are meant to simplify the picture.

Simplification itself is not harmful. Without it large environments cannot be managed. The problem begins when a metric stops being a tool and becomes the goal. Once the number of closed vulnerabilities, SLA compliance, or reduction in critical findings becomes the primary target, teams quickly adapt their behavior to those numbers. People start doing what they are measured on rather than what actually reduces risk.

Why organizations favor the wrong metrics

The answer is uncomfortably simple. Bad metrics are easy to understand and convenient to present. Total vulnerability counts fit neatly on a slide. Quarterly closure rates look good when colored green. SLA compliance reads well in monthly reports. These indicators require no lengthy explanations, avoid architectural discussions, and never raise awkward questions about assets that were never inventoried.

True risk metrics are more complex. They require context: external exposure of an asset, its business value, existence of working exploits, evidence of real-world exploitation, connections to other segments, accounts, and trust relationships. Such discussions fit poorly into a single chart and often lead to the uncomfortable conclusion that real attack paths may have shortened only marginally despite heavy remediation work.

Five common metric traps

Trap one: total vulnerability counts. Dashboards showing “total found,” “critical,” “high,” and “medium” create an illusion of control. They display volume and downward movement, yet the sum of findings says almost nothing about actual security. It measures the size of the problem set, not the probability of successful attack.

Trap two: CVSS deadlines without context. The idea seems reasonable: critical vulnerabilities fixed in one day, high in three days, medium within a month. The CVSS scale, however, describes the vulnerability itself, not its role inside a specific environment. It does not know whether the service faces the internet, whether the asset supports a key business process, or whether compensating controls exist.

Trap three: closure-rate targets. When “close 95 percent of findings” enters quarterly objectives, vulnerabilities become accounting units. Cards are closed formally, temporary workarounds are recorded as fixes, and root causes remain untouched. The report looks excellent while the infrastructure does not become meaningfully harder to attack.

Trap four: static dashboards without time. A report that shows only today’s snapshot hides how long problems have existed. An issue discovered yesterday and one that has remained on an external service for six months appear identical. Age of a vulnerability is often more important than its paper severity.

Trap five: “no critical vulnerabilities found.” The phrase reassures executives while concealing the real question: in what coverage, on which assets, with what limitations, and what remains outside visibility. Most surprises live at the edge of visibility—in shadow servers, forgotten subdomains, incomplete cloud inventories, and contractor infrastructure.

From vulnerability lists to attack paths

Even a well-run traditional program addresses only part of the problem. It handles known software weaknesses but does not answer how an attacker will combine vulnerabilities, misconfigurations, open services, weak credentials, excessive privileges, and trust relationships. Real attacks today succeed through such combinations.

Mature teams are therefore moving from simple vulnerability tracking to Continuous Threat Exposure Management (CTEM). This approach evaluates not individual findings but their role in realistic attack scenarios and prioritizes actions that reduce attacker reachability to critical assets. Tools such as MaxPatrol Carbon build graphs of attacker capabilities across the infrastructure and surface the most dangerous paths rather than the loudest CVEs.

The central question any mature process must answer is simple: how difficult is it for an attacker to reach what matters most to the business. If the dashboard does not help answer that question, it works against security rather than for it.

Meridian digestThe week's most consequential security stories, distilled into one briefing.See the digest

More in Vulnerabilities & Exploits

Telegram for Android Patches Voice Call Vulnerability Enabling Code Execution
Yandex Patches Millions of Stations After eMudhra Certificate Keys Compromised
Cisco ASA and FTD Face DoS Vulnerability in SSL VPN Already Exploited in the Wild