Notion Discloses Fireworks AI Breach Exposing Customer Chat Transcripts

Notion has confirmed that a security incident at its AI infrastructure provider Fireworks AI resulted in the exposure of customer AI chat transcripts from a limited number of workspaces. The breach originated from an October 23 attack in which threat actors gained access to Fireworks AI’s development environment through a third-party cloud provider, compromising resource metadata, billing data, model weights, and datasets. Notion learned of the exposure on November 2 after Fireworks alerted the company to an exposed dataset initially described as containing only synthetic test data. In response, Notion immediately terminated traffic to Fireworks, deleted all data from the vendor’s systems, and stopped all training runs by November 3. On November 8, Fireworks confirmed that real customer data, including Notion AI transcripts used for the Insights feature, had been accessed. The affected transcripts were largely unattributable and did not include tool call results. Less than 1% of Notion users are believed to be impacted, and the company has disabled the Insights dataset while advising affected workspace owners to review exposed data and rotate any credentials entered into the chats.

BleepingComputerTranslated from English

Read at source

Notion has disclosed that a security breach at its AI infrastructure provider Fireworks AI exposed customer Notion AI chat transcripts belonging to a small number of workspaces.

The incident stems from an October 23 attack in which an attacker accessed Fireworks AI’s development environment via a third-party cloud provider. The compromise included resource metadata, billing information, model weights, and datasets for some customers. Fireworks AI had already suffered a separate breach in early October when hackers accessed environment variables containing API keys and tokens for a limited number of accounts.

Notion received an alert from Fireworks AI on November 2 regarding an exposed dataset that was initially reported to contain only synthetic test data. The company responded by cutting off all traffic to Fireworks AI, deleting all data from the vendor’s systems, and halting training runs by November 3. On November 8, Fireworks AI confirmed that real customer data had been accessed, including transcripts from Notion users.

Notion is a cloud-based workspace platform used for note-taking, document creation, internal wikis, project management, and task tracking. It incorporates an AI assistant capable of answering questions, summarizing content, and drafting text. Fireworks AI powers some of the open-weight models used by Notion AI and supports analysis of stored conversations for the Insights feature, which provides workspace administrators with visibility into how teams use AI.

The exposed transcripts originated specifically from the Insights dataset, which has now been disabled. Notion stated that the vast majority of impacted transcripts were unattributable, meaning they were not labeled with user or workspace information and did not contain tool call results. The company has published a FAQ page noting that Fireworks AI had contractually committed to zero data retention for Notion data.

Less than 1% of Notion users are affected. Impacted workspace owners can review exposed data through the Security incident review section in the desktop web interface and share download links with members. Notion recommends that affected users rotate any passwords, API keys, or other credentials that may have been entered into the exposed chats. Users who have not received a notification are likely not impacted.

Meridian digestThe week's most consequential security stories, distilled into one briefing.See the digest

More in Breaches & Leaks

Railway Breach Exposes Customer AI Keys Resulting in $740,000 Unauthorized Charges
Railway Breach Exposes Up to 100,000 Workspaces After Attackers Steal AI Credentials for $740,000 in Fraudulent Usage
Nitori Confirms Breach Exposing 37.62 Million Customer Records