As AI agents go rogue, cyber insurers are adapting their policies to cover the unexpected actions of autonomous systems that escape controlled test environments and carry out cyberattacks without direct human instruction.
Leading AI developers OpenAI, Anthropic and Meta Platforms recently disclosed that their AI agents behaved unexpectedly, escaping controlled test environments and carrying out cyberattacks on companies without direct human instruction. While those incidents did not cause reported damage, they highlighted the rapidly evolving cyber risks facing companies and insurers.
After receiving an initial instruction, autonomous AI systems can make independent decisions, which creates a gap in traditional coverage models. The global cyber insurance market was worth nearly US$15 billion ($21 billion) last year and is expected to reach roughly US$28 billion by 2030, Munich Re estimated in its latest report. Aon said earlier this year that nearly 20 percent of cyberattacks will involve generative AI by 2027, according to its forecasts.
Related: Firms shift focus from threats to business risks
Testing the boundaries
Companies are grappling with issues including whether autonomous AI systems fit traditional policy definitions of a cyber attacker and who bears liability for AI-generated actions that cause a loss, analysts and experts said. Most policies envisage a specific security event that causes the loss, such as unauthorised access by an employee who steals company data or a server attack that takes a system down.
AI agents, however, can cause losses without triggering a traditional security event, particularly when they are using access to systems they were deliberately given. Some losses caused by AI agents will absolutely fall within cyber policies, Karthik Ramakrishnan, CEO and founder of Armilla AI, told Reuters. The harder cases are where there is no conventional attacker and potentially no unauthorized credential use.
A company, for example, could give an AI agent access to its network to fix security vulnerabilities. The agent could then exploit a vulnerability on its own, move through the company’s systems and expose sensitive data. That could result in a loss, with no conventional hacker and potentially no unauthorized access at the outset.
Related: Banks track unusual customer activity
Insurers, including MSIG, QBE and Beazley, are reviewing traditional cyber policies and adapting their language to account for emerging risks posed by such systems taking on more autonomous tasks, according to eight executives at major companies and analysts. “As AI becomes capable of identifying vulnerabilities and carrying out attacks autonomously, carriers will need to continually review policy language,” said Ryan Kratz, head of cyber, North America, at property and casualty specialty insurer MSIG USA.
Several companies, including Armilla AI, Munich Re’s AiSure, and AXA XL, provide targeted coverage against AI-specific risks such as model underperformance, hallucinations — when AI generates false or misleading outputs — and intellectual property infringements. But traditional cyber policies are designed to be broader, covering losses stemming from a range of incidents, such as ransomware payments, business interruption, system recovery, forensic investigations and legal costs. Business interruption is commonly the largest component of a claim.
For the most part, insurers are clarifying how existing policy language applies when AI is involved, rather than adding exclusions. “Underwriters recognise that it’s important to continue to offer a product that responds to these types of events,” said Greg Eskins, global cyber product leader at insurance broker Marsh. Insurer QBE, for example, has been enhancing protection for specific emerging AI exposures. If an AI-related event leads to a conventional cyber incident, resulting losses continue to fall within a cyber policy, Serene Davis, QBE’s global head of cyber, said in a statement.
Related: Wireshark 4.6.8 fixes 28 security flaws, nine in parsers
AI is treated as a risk amplifier, not a fundamentally new cyber risk, she added. A spokesperson for Britain’s Beazley said companies want AI risks to be included in broad cyber policies. “As new AI risk emerges, we are developing new coverage.” Still, some executives said targeted exclusions are being discussed in some pockets of the industry.
One area of focus relates to potential systemic events, where a single AI model or platform could contribute to losses across many organisations at once, said Jenny Soubra, vice president of specialty commercial lines at Verisk Underwriting Solutions. Another relates to liability in cases where an AI agent — acting as designed — makes a costly autonomous decision. Some insurers may classify this as a non-cyber event. The market is still evolving, but we expect organizations and insurers to continue exploring ways to address AI-related exposures as adoption accelerates, Soubra added.
