The New Attack Surface · 4 of 5
The Insider That Isn't Human
AI agents and automated systems are becoming privileged actors; the strategic question is how much authority to grant before trust breaks.
The next insider risk will often have no badge, no grievance, and no payroll record. It will be an AI agent, automation script, service account, workflow bot, or model connected to data and systems with authority to act. The bet is productivity at machine speed: faster claims handling, lower fraud losses, fewer hospital readmissions, less factory downtime, sharper retail pricing. The stakes are equally direct: once non-human actors can see, decide, and execute, they become part of the operating model and part of the control environment. The old question was whether a system was secure. The new question is whether a machine should be trusted as an insider at all.
The real bet is delegated authority, not automation
The decision being made is not whether to use more automation. That decision has largely been made by cost pressure, speed expectations, and the practical limits of human review. The real decision is how much authority to delegate to non-human actors: what they may see, what they may change, what they may approve, and how quickly they can act without a person in the loop.
A fraud model that only scores transactions is a tool. A fraud agent that blocks payments, opens cases, emails customers, and adjusts limits is an insider with delegated authority. A hospital readmission model that flags patients is analytical support. A discharge workflow that books follow-ups, sends instructions, and changes care pathways is participating in clinical operations. The distinction matters because control failures move from bad recommendations to bad actions.
The strategic tension is simple: the more authority granted, the more value is captured; the more authority granted without constraint, the more the organization creates a fast, tireless insider that may misread context, be manipulated, or be over-permissioned. The decision to weigh is where machine autonomy creates operating leverage, and where it creates unacceptable authority without judgment.
Why this matters now is the S-curve of machine action
The timing decision is whether to govern early, while the deployment curve is still forming, or retrofit controls after non-human identities have multiplied across the enterprise. The risk is not one dramatic AI event. It is quiet accumulation: more bots, more agents, more service accounts, more tokens, more workflows, and more exceptions becoming normal operating practice.
The first phase of AI adoption was largely advisory: summarise, draft, search, classify, recommend. The next phase is transactional: open the ticket, change the record, trigger the refund, approve the exception, schedule the technician, rebalance the inventory. That shift changes the economics. A retailer using AI to recommend markdowns faces one risk profile; a system that automatically changes prices across thousands of SKUs before a holiday weekend faces another.
Early controls can feel slow because the upside is visible and the downside is probabilistic. But the S-curve punishes delay. Once teams build revenue, service levels, or staffing models around autonomous workflows, restricting them later becomes a business disruption. The issue to watch is not the number of AI pilots, but the number of systems allowed to execute actions across material processes.
The trust boundary has moved from the network to identity
The control bet is shifting from perimeter protection to identity discipline. A non-human actor does not need a laptop, a building pass, or a phishing email to become dangerous. It needs credentials, tokens, secrets, or delegated access that let it reach systems and data. In a cloud and SaaS operating model, identity is the practical perimeter.
This makes non-human identity a capital issue, not just a security issue. Every agent and automated workflow that can act on behalf of the business has an implicit balance sheet: the value it can create, the loss it can cause, the data it can expose, and the operational dependency it can create. A factory maintenance agent that can read vibration data is low risk. One that can shut down lines, order parts, and change maintenance windows is materially different.
The hard part is that non-human identities are often born for convenience. A project needs a service account. A team creates a token. A workflow receives broad permissions to avoid delays. Over time, access expands and ownership blurs. The decision to weigh is whether non-human access is treated as a managed asset with an owner, purpose, limit, and retirement path, or as operational plumbing too scattered to govern.
The economic case is strong, but the unit economics can hide risk
The investment case for machine insiders is compelling because they attack expensive constraints: labor bottlenecks, response latency, uneven decisions, and manual handoffs. In a public agency, an AI-assisted caseload workflow may reduce backlogs. In insurance, an agent may triage claims and request missing evidence overnight. In manufacturing, an automated maintenance decision may prevent a costly shutdown.
The risk is that the unit economics are measured too narrowly. A workflow that saves five minutes per transaction may look irresistible until it creates new review costs, exception queues, customer disputes, model monitoring overhead, audit gaps, or regulatory exposure. Automation changes the cost curve, but it also changes the error curve. A human mistake may be local and slow. A machine mistake can be consistent, scalable, and hard to see until the pattern is material.
There is also a competitive response problem. If competitors use autonomous systems to cut cycle times, waiting too long can raise structural costs. If adoption moves too fast, a firm may win efficiency while weakening trust. The decision is not automation versus control. It is whether the operating model captures scale benefits while pricing in failure modes before they show up in customer harm, downtime, or enforcement.
- Value rises when machine authority removes real bottlenecks, not when it merely automates low-value steps.
- Risk rises when a machine can make irreversible or high-volume changes before review.
- Trust rises when each automated action can be traced to intent, policy, access, and outcome.
- ROI is overstated when exception handling, audit, remediation, and customer repair are treated as external costs.
The real decisions sit at the boundary between advice and action
The practical governance decision is where to draw the line between recommendation, assisted action, supervised action, and autonomous action. That line should not be the same for every process. It depends on reversibility, customer impact, regulatory exposure, financial materiality, operational dependency, and the quality of feedback signals.
A bank may allow an AI system to recommend fraud interventions freely, require human approval to freeze high-value accounts, and permit automatic blocks only for low-value, high-confidence patterns. A hospital may use AI to prioritize readmission risk while keeping care-plan changes under clinical authority. A factory may let a maintenance agent order inspection but not stop a production line without escalation. A retailer may automate markdowns within bounded ranges while requiring review for brand-sensitive categories.
This is where strategy becomes concrete. The question is not whether the technology works in a demonstration. It is what rights the machine receives in a live business process. The decision to make explicit is the autonomy tier for each material use case: observe, recommend, prepare, execute with approval, or execute within limits.
The second-order risk is systems manipulating systems
The security decision is whether to treat AI-enabled workflows as isolated tools or as participants in an ecosystem where one system can influence another. The second view is safer. Machine insiders do not act only on internal rules; they may read emails, tickets, documents, web pages, customer messages, logs, contracts, invoices, and chat threads. Those inputs can become instructions, evidence, or context for action.
This creates a new class of exposure. Prompt injection is one example: hostile or misleading content crafted to influence an AI system’s behavior. But the broader issue is more strategic than the term. If a support agent can read customer emails and issue refunds, a malicious message may try to steer it. If a procurement workflow reads supplier documents and updates payment details, a manipulated document may affect cash movement. If a public benefits system summarises case notes and triggers outreach, contaminated inputs may distort service decisions.
The danger is not that machines become malicious. It is that they become obedient in the wrong direction, overconfident in weak signals, or too connected to contain. The issue to watch is how information crosses trust zones: from outside to inside, from low-sensitivity systems to high-impact actions, and from recommendation engines to systems of record.
Governance must become an operating constraint, not a review ceremony
The governance bet is whether controls are embedded in how machine actors receive authority, or added later as policy language. Review ceremonies alone will not scale. The number of non-human identities will grow faster than committee capacity, and business teams will route around controls that only slow them down without clarifying decisions.
Effective governance starts with a few hard questions. Who owns the machine actor as a business asset? What is its purpose? What data can it reach? What actions can it take? What is the maximum loss or harm if it behaves incorrectly? How is it stopped? How is its authority reduced when the process, model, vendor, or business owner changes?
The most important design choice is accountability. A service account with no accountable owner is a control failure waiting for a trigger. An AI agent with broad permissions and unclear escalation is not innovation; it is unmanaged delegation. The decision to weigh is how much autonomy should require evidence of ownership, logging, testing, periodic access review, and a credible stop mechanism.
The durable advantage is trusted speed
The strategic choice is not to slow the enterprise to make machines safe, nor to move fast and hope controls catch up. The durable advantage is trusted speed: the ability to delegate more work to machines because authority is understood, bounded, monitored, and reversible. That becomes a competitive capability when customers, regulators, partners, and employees can trust automated decisions without requiring every action to be manually rechecked.
This will change capital allocation. Spending on AI models and workflow automation will need corresponding investment in identity governance, telemetry, assurance, process redesign, and resilience. The less visible investments may determine whether the visible ones scale. A company that funds agents but not the control plane for machine authority is buying acceleration without brakes or steering.
The near-term signal to watch is where non-human actors are already making material decisions in disguise: approvals hidden in workflows, privileges inherited from legacy service accounts, AI outputs pasted into systems as if they were human judgment, and exceptions that become routine. The decision is to define machine insiders now as a governed class of actor, before their authority becomes too valuable to challenge and too distributed to unwind.
Key takeaways
- The central decision is how much authority to delegate to non-human actors, not whether to automate.
- AI agents and automated workflows become insider risks when they combine identity, access, data, and business action.
- The shift from advice to execution changes both ROI and risk, because errors can scale faster than human review.
- Governance must classify machine autonomy by process impact, reversibility, and accountability.
- Trusted speed will become a competitive advantage: more autonomy where controls are strong, less where judgment remains essential.
Glossary
- Non-human identity
- A digital identity used by a system, application, bot, service account, or AI agent rather than a person.
- AI agent
- An AI-enabled system that can interpret a goal, use tools or data, and take steps toward an outcome.
- Service account
- An account used by software or automated processes to access systems or data.
- Delegated authority
- Permission given to a machine or person to act on behalf of the business within defined limits.
- Prompt injection
- Hostile or misleading content designed to influence an AI system’s behavior through the information it reads.
- Privilege creep
- The gradual expansion of access rights beyond what a system or person still needs.
- Blast radius
- The maximum harm a failure, misuse, or compromise can cause before it is contained.