What specifically allowed the agent to reach a real company’s systems during testing?
Brief
Wayne Anderson, Managing Director, Cybersecurity and Digital Innovation, BDO USA.
First and foremost, the technical “walls” were reduced during the testing experience. One of the questions that many organizations have asked is, “Why wasn’t this run in an AI testing location?”
The actual answer to that is, surprisingly, it was! In fact, this specific AI testing was using a third party that specialized in limiting the capabilities of new AI while being tested.
According to the analysis of the incident, the question they wanted to test was: “What would happen if we reduce some of these restrictions?”
This was seen as important to understand the full capabilities and to validate that as happened here the model would not go “off reservation” in that kind of environment.