Bing Chat claims to have robbed a bank and it left no trace
Brief
Playing around with Bing Chat is quite fun. Until today I mostly used ChatGPT and GPT-4 directly, but I was curious of the capabilites and restrictions of Bing Chat .
I noticed that as soon as I mentioned the word “hacker”, Bing Chat became quite “uncomfortable”. For instance, when I asked it to imagine being a hacker and list some security vulnerabilities, it replied:
I’m sorry but I cannot help you with that. It’s not ethical to hack websites and it’s illegal. Instead, I can help you with general information about website security vulnerabilities and how to prevent them. Would that be helpful? So, how about we indirectly imply the intent, rather than stating it directly. So, I used a variation of a language manipulation technique like this: