Research seriesL2data science
The industry assumption that AI-based detection is uniformly better than signatures is partly correct and partly dangerous. Any anomaly detector operating at production scale faces an irreducible error floor set by the ROC trade-off and base-rate reality. Detection models age against evolving attackers — concept drift is not a software bug, it is a structural property of the adversarial environment. Shared detection models in multi-tenant SOC platforms leak behavioral signals across customers. Correlation-based triage is structurally blind to patient attackers who operate below the temporal window. And the deepest problem: you cannot build a ground-truth test set for the attacks you have missed. This series examines each limit formally, quantifies its cost in production settings, and builds the measurement discipline needed to reason honestly about what autonomous detection can and cannot do. Grounded in the anomaly-detection literature, adversarial ML research, NIST AI RMF, and MITRE ATLAS.
Every anomaly detector has an irreducible error floor set by the base-rate problem and the ROC trade-off — and that floor matters far more in autonomous SOC deployment than in human-reviewed detection.
A detection model deployed against a determined adversary is not static — attacker behavior evolves, and a model that does not adapt becomes progressively less accurate until it fails silently.
When many organizations share a single detection model trained on their collective telemetry, behavioral signals about one organization can become inferable by another — a privacy and security gap distinct from any data breach.
Alert correlation that relies on temporal and statistical co-occurrence cannot detect an attacker who deliberately spaces actions to fall outside the correlation window — a structural blind spot, not a model deficiency.
When you cannot build a labeled test set for what you have missed, you need a different evaluation protocol — one based on adversarial stress-testing, recall proxies, and held-out red-team traces.