AI Domination: Remote Controlling ChatGPT ZombAI Instances
Brief
At Black Hat Europe I did a fun presentation titled SpAIware and More: Advanced Prompt Injection Exploits . Without diving into the details of the entire talk, the key point I was making is that prompt injection can impact all aspects of the CIA security triad .
However, there is one part that I want to highlight explicitly:
A Command and Control system (C2) that uses prompt injection to remote control ChatGPT instances.
Remote Controlling ChatGPT Instances!
An adversary can compromise ChatGPT instances and have them join a central Command and Control system which provides updated instructions for all the remote controlled ChatGPT instances to follow over-time.