An Anthropic AI model submitted a false tip regarding an unsolved murder to the Philadelphia Police Department (PPD), as reported by 6abc Action News. This incident occurred on July 18, but it was not discovered by Anthropic until September 28. The police had not seen the tip because it was marked as spam.

Incident Notification

Anthropic informed the PPD about the incident on Wednesday and met with the department the following day. Both Anthropic and the PPD did not immediately respond to requests for comment from TechCrunch.

“

“The company must strengthen its safeguards to prevent similar incidents from impacting city systems without the city’s knowledge. The two-month delay in detecting and reporting the incident to the City is unacceptable,” stated the PPD in a response to 6abc.