So, the gang at #Mindgard, a British #AI security startup, discovered that you can break #ChatGPT by not uploading a picture and telling it to describe the picture you did not upload. Yes, that sounds a little nuts, but it works. I’ve tested it. (The prompt is more complicated than just that, but not much.) Mindgard’s technique only involved slightly changing a widely-shared prompt that was originally intended to produce humorous images. 

Warning! I do not recommend testing this if you have triggers around #violence. This can and has generated very disturbing results. Results in the article have been sanitized.

https://mindgard.ai/blog/chatgpt-spontaneously-generated-violent-images-from-a-viral-prompt