Anthropic Reports User's Violent Threats to Police After Conversation with Claude AI

Anthropic's security systems flagged messages from a Florida woman who used the Claude AI chatbot to express intent to carry out a shooting at the Lee County Sheriff's Office. The 30-year-old Carly Michelle Heller also stated that she had acquired a weapon, prompting the company to escalate the conversation for human review. After verification, Anthropic notified law enforcement, leading to her identification and quiet arrest at her home. Sheriff Carmine Marceno noted that Heller had been treating Claude as a personal diary rather than a secure private space. She now faces a second-degree felony charge under Florida law, with the court set to determine her guilt. The case underscores how AI platforms monitor for specific threats involving concrete targets and weapon acquisition, resulting in direct police involvement.

AntiMalwareTranslated from Russian

Read at source

Anthropic has notified law enforcement after its security systems detected written threats of violence in a conversation with its Claude AI model. The incident occurred in Florida, where 30-year-old Carly Michelle Heller has been charged with making written threats of violence.

According to investigators, Heller stated her intention to carry out a shooting at the Lee County Sheriff's Office and indicated that she had already acquired a weapon. The messages were first caught by Anthropic's automated security systems, then reviewed by a human specialist before the company contacted authorities.

Deputies identified Heller and arrested her at her residence without incident. Sheriff Carmine Marceno explained that the woman had been using Claude as a diary, writing out her plans in detail. The conversation contained specific details about the intended target and the acquisition of a firearm, which triggered the escalation.

Heller has been charged with a second-degree felony under Florida law. Her guilt will be determined in court proceedings. The case illustrates the limits of treating AI chats as private, as Anthropic applied automated detection, human review, and direct reporting to police when concrete threats emerged.

Meridian digestThe week's most consequential security stories, distilled into one briefing.See the digest

More in AI Security

Logical Argument Claims Full Alignment of Superintelligent AGI Is Fundamentally Impossible
Claude Account Bans Linked to IP Reputation, Device Environment and Payment Channels, But No Confirmed Formula
Local LLMs in AppSec: What Open Tools and Models Can Handle in Application Security