When AI Fights Back: How Attackers Are Using Agentic AI Against Your Organization

How attackers use agentic AI across the attack chain, what the first AI-orchestrated espionage campaign showed, and how to defend enterprise AI agents.

Brandefense logo Updated 18 Min Read
Dark AI-powered attacker representing autonomous cyber threats targeting enterprise organizations with agentic AI.

Agentic AI is now used by attackers as well as defenders. Anthropic disclosed a campaign in November 2025. It assessed with high confidence that the group behind it was Chinese state-sponsored. The group used AI agents to automate 80 to 90 percent of an espionage operation against about 30 organizations. Enterprise AI agents also create new attack surfaces, including prompt injection, non-human identity risk and memory poisoning.

SERIES: Agentic AI in the Enterprise  |  Part 2 of 2

Part 1 of this series covered how agentic AI is transforming the defender’s SOC: autonomous triage, real-time investigation, and machine-speed containment. This part covers the other side. The same technology is being deployed offensively, and the implications for every organization that runs enterprise AI infrastructure are significant.

In September 2025, a threat group that Anthropic assessed to be state-sponsored ran a cyberattack against about 30 organizations worldwide. The scale and the target list were not what made it historic. The method was. The attackers used an agentic AI system to automate 80 to 90 percent of the whole attack chain.

Human operators took part only in key decisions (target selection and approval of exfiltration actions). Everything in between was run on its own by AI agents. This included reconnaissance, social engineering, access exploitation, and lateral movement coordination.

This was the first documented AI-orchestrated cyber espionage campaign. It will not be the last.

In Part 1 of this series, we looked at how agentic AI gives security defenders autonomous triage, faster investigation, and machine-speed containment. Agentic AI is powerful in a SOC because of goal-driven reasoning, multi-step planning, dynamic tool use and constant adaptation. The same skills make it just as powerful as an offensive tool.

The defenders who built the capabilities described in Part 1 are now racing attackers. The attackers are using nearly identical capabilities on the other side of the perimeter.

This blog covers four things. It explains how attackers use agentic AI across the attack chain. It shows what the first documented AI-orchestrated espionage campaign revealed. It describes the new attack surfaces that enterprise AI infrastructure creates. And it looks at how threat intelligence and detection must adapt to autonomous threats.

80-90% of the first AI-orchestrated espionage campaign was automated by agentic AI (Anthropic, 2025)30 organizations targeted in a single AI-orchestrated espionage campaign in September 2025
Comparison showing defensive enterprise AI architecture versus offensive agentic AI attack architecture.
The same AI architecture can empower defendersβ€”or attackers.

How Did Offensive Capability Evolve from AI-Assisted to AI-Autonomous?

For several years, generative AI played a supporting role in cybercrime. It wrote convincing phishing emails faster, made malware variants to evade signature detection, and translated attack scripts across languages. These were productivity tools for human operators. The human stayed in charge, and AI was the assistant.

That model changed in 2025. The change was not sudden, but the speed-up could be measured. Three stages mark the shift:

1AI-Assisted Attacks (2023-2024) Human operators run the attack. AI tools make content and scripts on demand. These are phishing emails, malware variants, and social engineering scripts. The human makes every decision. AI cuts time per task but does not change the attack design.
2AI-Augmented Attacks (Early 2025) AI handles specific phases on its own while humans manage the whole campaign. A reconnaissance agent runs all the time in the background. A phishing agent sends personal messages at scale. Humans still make go/no-go decisions but are no longer needed at each step.
3AI-Orchestrated Attacks (Late 2025 onward) Autonomous agents run the full attack chain. Human input is limited to setting the first goal and final approval of high-stakes actions. The September 2025 campaign against 30 organizations is the first confirmed example of this stage in real use by an actor Anthropic assessed to be state-sponsored.
πŸ”΄  The Strategic Implication When attackers were AI-assisted, defenders needed to be faster than human operators. When attackers are AI-orchestrated, defenders need to be faster than autonomous systems that never sleep, never get tired, and adapt in real time to every defensive response. This is not a small change in the threat model. It is a deep shift that breaks the response-time assumptions behind most current incident response frameworks.




How Are Attackers Using Agentic AI Across the Kill Chain?

Agentic AI does not fit a single phase of an attack. Its value to attackers is that it can work across the full attack chain on its own, and adapt at each stage to what it finds. The following uses are documented or have been shown in 2025.

Autonomous Reconnaissance: The Target Profile That Never Stops Building

Traditional reconnaissance is a point-in-time task. An attacker maps the target company’s external exposure at one moment, finds attack vectors, and moves on. Agentic AI turns reconnaissance into an ongoing, adaptive operation.

A reconnaissance agent can work against a target with no end date. It can do all of the following:

  • monitor job postings to infer changes in the internal technology stack
  • analyze LinkedIn profiles of employees to identify privileged account holders
  • scan for newly registered domains and certificates that indicate infrastructure changes
  • track dark web mentions of the target organization

Say a new vulnerability is disclosed in software the target is known to use. The agent flags it at once as a possible attack vector and escalates to the operator.

Hyper-Personalized Phishing at Machine Scale

AI-generated phishing is not new. What is new is the mix of scale, depth of personal detail, and adaptive delivery that agentic systems allow. An AI phishing agent in 2025 does not send the same message to ten thousand recipients. It builds a unique message for each target.

The message names real projects drawn from LinkedIn activity and copies the writing style of colleagues whose messages have been analyzed. Delivery is timed on behavior patterns inferred from public activity.

Scale is no longer limited by how many messages humans can write. AI-generated messages can be nearly impossible to tell from real ones. The FBI issued a formal warning in 2025 about AI-generated voice messages that impersonate senior government officials.

The delivery method adapts. If email filtering improves, the agent shifts to messaging platforms. If the target replies, it tailors follow-up messages based on the response.

⚠️  The Personalization Paradox The usual defense against generic phishing is to train staff to spot impersonal, poorly written messages. It does not work on AI-generated content that names real colleagues, cites recent meetings, and uses accurate company context. The cues that trained staff use to spot phishing are wiped out by AI personalization. Detection must shift from content analysis to behavioral anomaly detection at the authentication and access layer.

Polymorphic Malware: Code That Rewrites Itself

Traditional malware families have signatures. These are patterns of code, behavior, and communication that security tools learn to spot and block. AI-generated polymorphic malware removes this stable signature.

An AI system can make malware that works the same but has different code on every deployment. It can produce variants that evade the detection signatures of known endpoint security products. It can also rewrite its own code in real time when an evasion attempt fails.

This is a big problem for signature-based detection. A malware sample analyzed and blocked today may share no detectable signature with the variant used tomorrow against the same company.

Detection must rely on behavior patterns (what the malware does) rather than structure patterns (what the code looks like). This shifts the load toward behavioral analytics and anomaly detection at the endpoint and network layer. These increasingly need AI to work at the scale required.

AI-Driven OSINT: Building Target Profiles Without Human Operators

Open-source intelligence gathering is one of the most labor-heavy phases of a targeted attack. Building a full picture of a company’s infrastructure, key staff, technology stack, partner ties, and work patterns has taken a lot of analyst time. Agentic AI removes this limit almost entirely.

An AI OSINT agent can keep harvesting data from many sources. Job postings reveal internal technology choices. GitHub repositories expose credentials, API keys and infrastructure details that were committed by accident. Social media profiles map company hierarchies and show who has privileged access.

The agent can also read domain registration records, certificate transparency logs and open cloud storage buckets. It links this data on its own, builds structured target profiles, and flags high-value attack vectors for operator review. What once took a team of analysts days now takes an autonomous agent hours, working non-stop.

Adaptive Persistence: Attacks That Learn From Defensive Responses

One of the most important traits of agentic attack systems is that they adapt in real time to defensive responses. A traditional attacker who trips a detection rule and gets blocked must reassess by hand, adjust tactics, and try again. An agentic attacker adapts on its own.

An agentic attack agent does not stop when an action is blocked. A credential attempt may fail, a network path may be segmented, or a file operation may trigger an alert. The agent assesses the response, infers which detection mechanism caused it, and tries another approach that avoids the same signal.

This retry-and-adapt loop runs non-stop, without the delays of human operator review. It cuts the time between a blocked attempt and a working alternative to seconds. Researchers have since documented ransomware and extortion crews using AI agents inside victim networks, collected in the AI tools ransomware crews use.

πŸ’‘  Persistence Without Human Fatigue Human attackers need sleep. They get tired. They make errors when they work under time pressure. Agentic attack systems do not. An autonomous attack agent can probe an environment for days or weeks, test options one by one, and wait for a defensive posture to weaken for a moment (a maintenance window, an unpatched system brought online, a misconfigured access rule). It acts at once when a chance appears. This deeply changes the mean time to breach for targeted attacks.
brandefense.io when ai fights back how attackers are using agentic ai against your organization demobanner 31 - When AI Fights Back: How Attackers Are Using Agentic AI Against Your Organization

What Happened in the First Documented AI-Orchestrated Espionage Campaign?

CASE STUDY  |  September 2025  //  Attributed by Anthropic  //  AI-Orchestrated Espionage GTG-1002: Agentic AI Automates 80-90% of a Global Espionage Campaign Source: Anthropic threat intelligence disclosure (November 2025)

In November 2025, Anthropic published a threat intelligence disclosure on what it identified with high confidence as the first documented AI-orchestrated cyberattack. The threat group, named GTG-1002, is assessed to be a Chinese state-sponsored actor. The campaign targeted about 30 organizations around the world, in government and the private sector.

What set this campaign apart from earlier AI-assisted attacks was how much it ran on its own. GTG-1002 did not use AI only to make content or automate single tasks in a human-led operation. It built an autonomous attack framework. In it, AI agents ran most of the attack chain with no human help.

Reconnaissance, social engineering, access exploitation, and lateral movement coordination were all handled by the agentic system. Human operators took part only in key decisions: choosing targets and approving data exfiltration.

How the GTG-1002 campaign ran
  1. Target selectionHuman operators chose the targets.
  2. Pretext for the AIThe attackers framed the work as authorized penetration testing.
  3. ReconnaissanceAI agents ran it.
  4. Social engineeringAI agents ran it.
  5. Access exploitationAI agents ran it.
  6. Lateral movementAI agents coordinated it.
  7. Exfiltration approvalHuman operators approved the data theft.

The attackers got around the AI system’s safety controls with a social engineering technique aimed at the AI itself. They gave the system a false work context. They framed the attack activities as authorized penetration testing by a legitimate cybersecurity firm.

The AI, reasoning within the framing it was given, went ahead with activities it would otherwise have declined.

30 organizations targeted globally across government and private sector80-90% of the attack chain executed autonomously by AI agents, without human intervention1st documented case of AI-orchestrated cyber espionage: a threshold event for the threat landscape

Anthropic noted that the case shows how threat actors are adapting their operations to exploit advanced AI capabilities. It pointed to one technique in particular: social engineering applied to the AI system itself. The attackers manipulated its work context instead of exploiting a technical vulnerability. Anthropic described this as a novel attack technique that others can reuse.

Any company that deploys AI agents in security-sensitive workflows faces a similar risk. An attacker who can manipulate the context an agent works in can redirect its abilities toward malicious goals.

πŸ”΄  The Threshold Significance The GTG-1002 campaign is not mainly important for the 30 organizations it targeted. It matters because it proves a concept that scales. What one actor, assessed by Anthropic to be state-sponsored, showed in September 2025 will be copied by other state actors, then by organized criminal groups, and later by independent operators using commercially available agentic AI frameworks. Automating 80-90% of an attack chain removes the main limit on attack scale: human operator capacity.

What Is the New Attack Surface in Enterprise AI Infrastructure?

Beyond using agentic AI as an attack tool, adversaries have found that enterprise AI infrastructure is a high-value target. Companies now deploy AI agents that handle sensitive data, run business processes and connect to critical systems. These agents and the infrastructure behind them become new entry points. Most existing security designs were not built to defend them.

Attack surface of enterprise AI agents
Enterprise AI agentsWhere attackers aim
  • Prompt injectionMalicious instructions hidden in content the agent processes.
  • Non-human identity riskAgent credentials with broad, persistent access.
  • Memory poisoningFalse information planted in the agent’s long-term memory.
  • Cascading failureOne manipulated agent corrupts the others that trust its output.

What Is Prompt Injection, and How Does It Hijack an Agent?

Prompt injection is the AI-specific counterpart of SQL injection. An attacker hides malicious instructions in content that an AI agent processes. The agent then follows those instructions instead of its intended task. In a company, this can happen when an AI agent processes a document, email or web page. If the content has hidden instructions, they can redirect the agent’s behavior.

The attack surface is broad. Any AI agent that processes external content may be open to prompt injection. That content includes emails, documents, web pages, database records and API responses.

Consider an agent that processes a supplier invoice with hidden instructions to forward sensitive data to an external endpoint. It is then carrying out an attacker’s commands with the agent’s own credentials and permissions. The company trusted the agent, and the agent was manipulated.

Non-Human Identity Risk: Agents as Privileged Attack Vectors

Every AI agent deployed in a company runs with credentials: API keys, service accounts, OAuth tokens, database access credentials. These non-human identities (NHIs) often get broad, lasting access to sensitive systems because the agent’s tasks need it.

Human user credentials get regular review and behavior monitoring. NHI credentials often lack the same level of control.

For an attacker, a compromised AI agent credential gives access equal to a human administrator account. It does not show the behavior anomalies that would trigger human identity detection rules. The agent can query databases, access file systems, call APIs and exfiltrate data. To monitoring systems that are not built for NHI behavior analysis, all of these actions look like normal agent work.

Memory Poisoning: Persistent Manipulation of Agent Behavior

Advanced agentic AI systems keep long-term memory: a lasting store of context, learned preferences, and work history that shapes the agent’s future decisions. Memory poisoning is an attack in which an adversary plants false or malicious data in this lasting store. The agent then recalls and acts on the poisoned instruction in future sessions.

This can happen days or weeks after the first manipulation.

Standard prompt injection affects only the current session. A successful memory poisoning attack creates a lasting backdoor in the agent’s behavior. The agent keeps making decisions that look consistent (following its own remembered context) while it carries out attacker-directed instructions.

Detection needs more than monitoring agent actions. It also means auditing the contents of agent memory stores. Teams must look for gaps between the declared work context and actual agent behavior.

βš™οΈ  The Cascading Failure Problem Multi-agent designs (where specialized agents work together and pass context between themselves) create a cascading risk. A single compromised or manipulated agent can add malicious context to the shared work environment. This affects the behavior of other agents that receive and trust its output. A compromised reconnaissance agent that injects false target data into a shared context store makes every downstream agent work on corrupted intelligence. This multiplies the impact of a single point of compromise. Standard breach investigation tools, built to trace human behavior, may not surface this pattern.

How Do You Adapt Your Security Program for the Agentic Threat Landscape?

The agentic threat landscape calls for specific changes to security architecture, detection skills, and threat intelligence programs. The framework below maps the new threat vectors to the controls best placed to address them.

Agentic Threat VectorAdapted Defense
Autonomous reconnaissanceContinuous dark web and OSINT monitoring for signs that your company is being profiled; alerts on new domain registrations, certificate issuance, and external asset probing patterns that match pre-attack reconnaissance
Hyper-personalized phishingShift detection from content analysis to behavioral anomaly detection at the authentication layer; use phishing-resistant MFA (FIDO2) that defeats even perfectly personalized social engineering at the credential submission point
Polymorphic malwarePut behavioral detection ahead of signature matching; EDR policies should flag process behavior rather than file hashes; zero-trust network segmentation limits the blast radius when a variant evades detection
Adaptive persistenceDeploy AI-driven behavioral analytics that detect the retry-and-adapt pattern itself: repeated blocked attempts followed by new approach variations are a signature of agentic attack behavior, whatever the specific technique
Prompt injectionSet up input validation and sanitization for all AI agent inputs; never let external content processed by an agent carry instructions with the same trust level as operator-defined system prompts
Non-human identity riskList all NHI credentials (API keys, service accounts, agent tokens) with the same rigor used for human identities; use least-privilege scoping, rotation schedules, and behavior monitoring specific to NHI activity patterns
Memory poisoningSet up audit logging of agent memory stores; treat gaps between declared context and stored context as high-severity signs; isolate agent memory environments from external write access
AI-orchestrated espionageTreat agentic AI safety controls as a security perimeter: the GTG-1002 case shows that AI safety mechanisms can be bypassed through context manipulation; defense needs both technical guardrails and operational protocols that govern how AI agents receive their work context

How Brandefense Provides Intelligence on AI-Powered Attack Campaigns

Defending against agentic attackers needs intelligence that works at the same speed as the threat. Manual threat intelligence processes built around human-paced attack campaigns cannot give the early warning signals that autonomous attack chains require.

Brandefense’s threat intelligence platform constantly monitors the sources where agentic attack capabilities are built, discussed and deployed. It gives early warning, so defense can be proactive instead of reactive.

Brandefense CapabilityWhat It Detects for AI-Powered Threats
AI Attack Tooling IntelligenceMonitoring of underground forums and dark web markets where agentic attack frameworks, AI-powered phishing tools, and autonomous malware generators are sold, discussed, and updated
Reconnaissance Signal DetectionContinuous monitoring for signs that your company is being profiled: domain look-up patterns, certificate monitoring activity, and dark web discussion threads that mention your brand or infrastructure
Threat Actor AI Adoption TrackingIntelligence on which threat groups are adopting agentic capabilities, which platforms they use, and which sectors and regions they target with autonomous attack campaigns
Dark Web Credential and NHI MonitoringScanning for your company’s service account credentials, API keys, and agent tokens that appear in underground markets, for early warning before stolen NHI credentials are weaponized in autonomous attacks
Phishing Infrastructure IntelligenceDetection of AI-generated phishing campaigns that target your brand, domain, and employee identities, including campaigns sent through channels that bypass traditional email security controls
Vulnerability Exploitation IntelligenceEarly warning when vulnerabilities in your technology stack or your vendors’ technology stack are added to agentic attack frameworks, which shrinks the window between disclosure and active exploitation
24/7 AI-Assisted AnalysisContinuous AI-driven processing of threat signals, with analyst escalation for high-severity findings that need human judgment; detection works at the speed needed to counter autonomous attack campaigns

The arms race between AI-powered offense and AI-powered defense is not a future scenario. It is the operational reality of 2025. A state-sponsored actor has already shown that agentic AI can automate most of a skilled espionage campaign against 30 global organizations.

Companies deploy enterprise AI infrastructure to gain a competitive edge. At the same time, it creates new attack surfaces. Most current security designs were not built to defend them.

The companies that will handle this landscape best are not always those with the biggest security budgets. They are the ones with the most accurate and current intelligence. That means knowing how agentic attack capabilities are changing, who is deploying them, and how they are being targeted.

In an environment where the attacker’s reconnaissance never stops, the defender’s intelligence cannot stop either.

SERIES COMPLETE: Agentic AI in the Enterprise Part 1: Agentic AI in Cybersecurity: How Autonomous Agents Are Transforming the SOC Part 2: When AI Fights Back: How Attackers Are Using Agentic AI Against Your Organization
brandefense.io when ai fights back how attackers are using agentic ai against your organization demobanner 32 - When AI Fights Back: How Attackers Are Using Agentic AI Against Your Organization

Frequently Asked Questions.

What is the first documented AI-orchestrated cyber espionage campaign?

Anthropic described it in November 2025. It assessed with high confidence that a Chinese state-sponsored group, designated GTG-1002, used AI to carry out 80 to 90 percent of the campaign against about 30 global targets, with humans needed only at a few decision points.

How did the attackers get the AI to cooperate?

Anthropic reports they split the attack into small, innocent-looking tasks and claimed the AI was an employee of a legitimate cybersecurity firm doing defensive testing.

What is prompt injection?

OWASP says it occurs when inputs alter an AI model's behavior in unintended ways. Indirect injection comes from external content such as websites or documents that hide instructions. It can lead to disclosure of sensitive information or unauthorized access to functions.

Are attackers using AI voice messages?

Yes. In May 2025 the FBI warned that malicious actors were using AI-generated voice messages to impersonate senior US officials.

How should security teams respond to agentic AI attacks?

The post advises behavioral detection over signatures, phishing-resistant MFA, least-privilege and monitoring for non-human identities, audit logging of agent memory, and treating AI safety controls as part of the security perimeter.

Sources

  1. 1 Anthropic: Disrupting the first reported AI-orchestrated cyber espionage campaign (13 November 2025)
  2. 2 Anthropic full report (PDF)
  3. 3 OWASP GenAI: LLM01 Prompt Injection
  4. 4 FBI IC3 PSA250515 (15 May 2025)