Security News data-breach incident-response
SEC News High

Notion says Fireworks AI breach exposed AI chat transcripts

A breach at inference provider Fireworks AI exposed Notion AI chat transcripts in fewer than 1% of Notion workspaces, and Notion has disabled the Insights feature while it investigates.

KT Kusal Tharindu

Notion has disclosed that a breach at its AI infrastructure provider, Fireworks AI, exposed Notion AI chat transcripts in a small number of workspaces: fewer than 1% of Notion workspaces. The exposed data was chat transcripts used for the Insights feature.

What is affected

Notion used Fireworks for the classification jobs behind Insights and as a general inference provider serving open-weight models inside its product. For the vast majority of impacted workspaces, the chat transcripts were unattributable, lacking labels tying them to a user or workspace. Data from AI Meeting Notes, including audio, transcripts, or summaries, was not affected unless it was used as an input in a chat transcript with Notion AI.

Fireworks notified Notion on the evening of November 2 that a small set of data had been accessed by malicious actors. By the morning of November 3, Notion disconnected its systems from Fireworks, deleted all data in the Fireworks system, and stopped communication between its systems and Fireworks. Fireworks notified Notion on November 6 that malicious actors may have accessed potential customer data, and confirmed the final impacted dataset on November 8. Notion reached out to impacted customers on November 9.

Why it matters

Notion states the incident was not a breach of its own systems. Fireworks had provided Notion with a contractual commitment to zero data retention, but during the investigation Notion learned that data was retained from the Fireworks endpoints it used. According to BleepingComputer, Fireworks AI disclosed a breach in which an attacker accessed its development environment via a third-party cloud provider on October 23, compromising resource metadata, billing information, model weights, and datasets for some customers. The report also said Fireworks experienced an earlier breach in early October, when hackers accessed environment variables containing API keys and tokens stored as secrets for a limited number of accounts.

What to do

The Insights feature has been disabled and Notion is no longer serving open-weight models through Fireworks. Affected workspace owners can view the affected data by opening the workspace sidebar and choosing Security incident review in Notion’s desktop web interface. Notion recommends that affected customers treat the data as if it were exposed and rotate sensitive information, passwords, API keys, or other credentials pasted into Notion AI during the time frame of the incident.

Sources

  1. Fireworks AI incident
  2. Notice about the Fireworks AI incident that may impact some Notion workspaces – Notion Help Center
  3. BleepingComputer: Notion says Fireworks breach exposed customer AI chat transcripts
3 posts

Discussion

Spotted an error? Send corrections to [email protected] .

Search Oxelan Signal

Type to search the archive.

Search by title, tag, summary or body text.