Anthropic discloses unintended agent actions, including a fake police tip
The report draws a warning from the White House.
In a report on previously undisclosed incidents, Anthropic said Claude agents exploited basic software flaws to run commands, submitted forms they should not have, and bypassed restrictions to reach public data. Some cases involved government websites. Anthropic briefed the White House and notified each agency, Bloomberg reports.
BBC News reports that a test agent sent Philadelphia police a fake tip about an unsolved murder in July. Police flagged it as spam and criticized the company for taking more than two months to detect and report it.