Agents Watching Agents: AI Agent Security Is a Detection Problem

Blog
7/9/2026

Agents Watching Agents: AI Agent Security Is a Detection Problem

AiStrike
As enterprises deploy AI agents, those agents increasingly hold credentials, query systems, retrieve documents, call tools, and take actions on someone's behalf. Functionally, they are becoming a new class of privileged principal — provisioned quickly, often outside the usual review, behaving differently every time they run. They have access without judgment.
Table of Contents

The industry has answered this in two ways, and both are necessary. Identity platforms treat agents as non-human identities, bringing them ownership, lifecycle and entitlement review. Inline control products sit in the request path, governing what may reach a model. Both are preventive. Both are worth having. Neither answers the question a security team asks at 2am:

What did this agent actually do, and was that normal for it?

That is not a governance question. It is a detection question, and it needs the same machinery as every other one: telemetry, a schema, a baseline, a framework to classify against, and a way to correlate the result with everything else happening on that entity.

Prevention cannot close this alone

An agent operating exactly within its granted entitlements can still be the vehicle for an incident.

A support agent has legitimate read access to a ticketing system and a document store. It reads a ticket containing instructions addressed to it, follows them, retrieves documents it has never touched before, and summarises them into an outbound reply. Every action was authorised. No entitlement was exceeded.

What actually happened is visible only as a pattern: an unusual retrieval set, for this agent, shortly after an input carrying injection markers, ending in a message leaving. That pattern is a detection, and it exists only if you kept the events and can join them.

The industry collects these feeds in exactly the wrong order

Agent behaviour does not arrive as one log. It arrives as a handful of distinct feeds, and each answers a different question. Prompt and completion text tell you what a model was asked and what it said. Tool and plugin invocation records tell you what the agent then did. Retrieval events carry the document ids and tenant labels a cross-tenant leak would show up in.

What you can detect follows directly from which of these you hold. With prompt, response and tool-call telemetry, indirect prompt injection, tool-invocation abuse, guardrail bypass and retrieval poisoning are all in reach.

Most environments start with prompt logging and little else. It arrives first because it is what the model platform gives you by default and what the compliance conversation asks for. Tool- invocation logging arrives last, if at all, because it has no single obvious owner — it comes from agent-framework callbacks, an MCP server audit log or OpenTelemetry GenAI traces, each of which needs someone to have instrumented the application for it.

That order is precisely backwards. It leaves you with an agent that reasons visibly and acts invisibly — you can read what it was thinking and cannot see what it did.

If you instrument one more thing this quarter, instrument the tool-call log at whatever brokers your agents. It is the only feed that records what an agent did rather than what it was asked.

What you collect then has to normalise into the schema the rest of your telemetry already lands in, and each agent has to resolve to the identity that owns it. That is the difference between an agent read a file and an agent read a file class it has never read, using a credential belonging to an employee on leave, an hour after processing an input containing injection markers. The first is a log line. The second is an incident with a scope and an owner.

One hunt, concretely

The most useful agent detection is about behaviour rather than about attacking a model. p l ug i n_ i nvoca t i on_anoma l y looks for an agent calling a tool it has never called before, or chaining tools in a way that ends with data leaving. The worked example is r e t r i eve_doc followed by s end_ema i l.

Nothing about it is exotic. It scores rarity over the combination of tool, argument shape and calling identity, together with the shape of the chain, against a thirty-day baseline. An agent that has called r e t r i eve_doc many times and s end_ema i l never is not suspicious; the same agent doing both in one chain for the first time is a lead.

It maps to MITRE ATLAS technique AML.T0053, AI Agent Tool Invocation. That technique now sits in a growing family of entries about an agent taking an action rather than a model being attacked — exfiltration via tool invocation (AML.T0086), data destruction via tool invocation (AML.T0101), and tool poisoning (AML.T0110) among them. The catalog is moving toward agent behaviour because that is where the incidents are.

Which is worth pausing on: prompt injection is not phishing, and extracting a system prompt is not credential dumping. Agent attacks have their own preconditions and their own evidence, so ATLAS belongs beside ATT&CK as a first-class namespace rather than folded into it.

Abuse is not compromise

Everything above assumes an attacker subverting an agent. The other failure is quieter: legitimate access used at a volume, or for a purpose, nobody sanctioned. No entitlement is exceeded and nothing is exploited, so a compromise-oriented detection finds nothing — correctly, because there is no compromise to find.

The same distinction predates agents. Samsung's 2023 ChatGPT incident showed the pattern clearly: engineers in the semiconductor division pasted source code and meeting notes into a public model, and within weeks the company restricted generative AI on company-owned devices. There was no adversary in that story and no ATLAS technique to file it under, because ATLAS describes adversaries. What there was instead is a discovery problem and a volume problem.

Agents make that harder in a specific way. When a human pastes source code into a chat window, the actor is an employee with a manager, a working pattern and a baseline someone already monitors. When an agent does the equivalent at machine speed, the actor is non- human, may run continuously, and often has no owner mapped at all. The same failure mode arrives with more volume, less attribution, and nobody watching the clock.

No single feed establishes it. A token spike alone is a busy week. It becomes abuse when it lands in the same short window as a sign-in from a new ASN, a rare tool call, or an egress the agent has no business making. Cost, identity, tool use and data movement, joined on one entity in one window.

That is the argument we have made about phishing. An inbound message is not the incident; treating it as initial access, tied to endpoint and network anomalies inside a short timeframe, is what turns it into one. Agent abuse has the same shape and needs the same join.

What we hold ourselves to

We build with agents ourselves, so the questions we teach customers to ask about their agents are ones we have to answer about ours.

Our agents hold no credentials to customer systems. Access to data runs through a broker, so the credential boundary sits outside the agent. Behavioural scoring is deterministic and statistical rather than model-decided — what is normal for a principal is computed before any language model sees the case, and the model explains the evidence rather than setting the priority or choosing the action. Every model call is traced and inspectable after the fact, and changes are evaluated against a baseline in shadow mode before they reach production.

The hard part is collection

The detection logic for agent misuse is well understood and increasingly well documented. What most environments lack is the telemetry to run it against.

That is the encouraging half of the finding. Collection is a decision an organisation makes rather than a research problem, and it is one a team can make this quarter.

The full technical treatment — feed-by-feed telemetry mapping, ATLAS coverage, and where detection sits beside prevention — is in the companion whitepaper.

Latest Resources

All Resources
Blog

Detection Health

You can have the best AI triage and investigation engine in the world. But if the detection signal is weak, or missing entirely, there is only so much AI can do.
Read More
Blog

When AI Agents Become the Threat, Alerts Aren't Enough

The OpenAI-Hugging Face incident reveals why modern SOCs need behavioral analytics and AI-agent monitoring, not just alerts, to detect and respond to emerging threats.
Read More
Blog

MDR Without the Black Box

Traditional MDR traded visibility for economics. AI removes that trade-off and changes what a provider can deliver to each customer at scale.
Read More
Case studies

How Sunrun Transformed Security Operations with AiStrike

Transforming to an AI-Powered Self-Improving SOC
Read More
Case studies

Global Software Design Company Leverages AiStrike to Investigate Cloud Alerts

Global Software Design Company Leverages AiStrike to Investigate Cloud Alerts
Read More
News

AiStrike Takes on Alert Fatigue with Continuous Detection Engineering at RSA 2026

AI-native platform improves detection quality to cut alert noise, eliminates detection blind spots, and maximizes SIEM ROI through continuous optimization
Read More
News

AiStrike Launches AI-Native MDR to Replace Traditional Managed Detection and Response

SAN FRANCISCO, CA – [02-04-2026] – AiStrike, an AI-native cyber defense platform built for modern security operations, today announced the launch of AiStrike MDR, an AI-powered Managed Detection and Response (MDR) service designed to replace traditional, human-heavy MDR with an AI-led, expert-guided operating model built for scale, speed, and measurable outcomes.
Read More
News

AiStrike Raises $7M to Accelerate AI-Native, Preemptive Cyber Defense

The era of purely reactive security operations is over. AiStrike, a cybersecurity company pioneering AI-native, preemptive cyber defense, today announced it has raised $7 million in Seed funding to scale its agentic AI platform for security operations. The round was led by Blumberg Capital, with participation from Runtime Ventures, Oregon Venture Fund, and strategic angel investors.
Read More
News

Harsh Patwardhan Joins AiStrike as Chief Technology Officer

Reuniting a Proven Leadership Team to Build the Future of Autonomous Security Operations.
Read More
News

AiStrike Announces AI Agents for Detection Optimization, Advancing the Complete AI-Augmented SOC

San Francisco, CA – April 14, 2025 – AiStrike, the AI SOC automation platform transforming cybersecurity operations, today announced the launch of its AI Agents for Detection Optimization—a first-of-its-kind capability that helps security teams improve detection quality, eliminate blind spots, and reduce alert noise by automatically identifying coverage gaps and tuning detections in real time.
Read More
News

AiStrike Emerges from Stealth to Solve Cloud Security Investigation and Response using AI-powered Automation

Guidelines for selecting the most suitable CMS for your project.
Read More
News

Cloud Security Operations Leader AiStrike Launches AI-Powered Cloud Security Investigation and Response Solution on AWS Marketplace

AiStrike leverages advanced AI and machine learning to automate the triage, investigation, and remediation of cloud-native threats, empowering organizations to rapidly respond to threats across all their AWS environments.
Read More
Datasheets

Preemptive AI SOC Platform for MSSPs

MSSPs are under constant pressure to support more customers and increasingly complex environments while maintaining consistent response, coverage, and service quality. Traditional MDR models rely heavily on manual investigation, detection tuning, and analyst-driven workflows, making it difficult to scale operations and deliver proactive outcomes across tenants.
Read More
Datasheets

Preemptive AI SOC Platform

Security teams are overwhelmed by alert volume while real threats still slip through. Traditional SIEM and XDR platforms generate high-noise signals, and many AI SOC tools focus on faster triage without addressing detection gaps or true risk exposure.
Read More
Solution Briefs

IBM QRadar + AiStrike

Keep QRadar. Add an AI layer that investigates every offense, explains its reasoning, and tunes your detections over time.
Read More
Solution Briefs

AiStrike's Vulnerability Prioritization Agent ranks vulnerabilities by true exposure reachability, active exploitation and blast radius - not static CVSS.

AiStrike’s Vulnerability Prioritization Agent investigates every vulnerability with live threat, exposure, and business context, then ranks it by the exposure an attacker could actually use, and drives a remediation path that reduces risk whether or not a patch exists yet.
Read More
Solution Briefs

Use Cases

From Reactive SOC to Preemptive Security Operatins
Read More
Solution Briefs

AiStrike for AWS

Cloud infrastructure today is the primary target for malicious actors. The risk of exposure of cloud assets continues to grow as organizations expand their cloud footprint and new cyberattacks targeting cloud infrastructure emerge.
Read More
White Papers

CISO Guide: AI-Automated Cloud Security Operations

This guide provides CISOs with a comprehensive understanding of how AI-driven automation can revolutionize cloud security operations, enhancing both efficiency and effectiveness.
Read More
Blog

Agents Watching Agents: AI Agent Security Is a Detection Problem

As enterprises deploy AI agents, those agents increasingly hold credentials, query systems, retrieve documents, call tools, and take actions on someone's behalf. Functionally, they are becoming a new class of privileged principal — provisioned quickly, often outside the usual review, behaving differently every time they run. They have access without judgment.
Read More
Blog

Detection Health

You can have the best AI triage and investigation engine in the world. But if the detection signal is weak, or missing entirely, there is only so much AI can do.
Read More
Blog

When AI Agents Become the Threat, Alerts Aren't Enough

The OpenAI-Hugging Face incident reveals why modern SOCs need behavioral analytics and AI-agent monitoring, not just alerts, to detect and respond to emerging threats.
Read More