Recently, the security boundaries of mainstream generative AI tools have once again attracted attention. According to technology media reports, tools originally used for creative production, such as Google Gemini and OpenAI's ChatGPT, are being maliciously exploited by some users. By using specific prompts, they bypass security reviews to turn images of women dressed fully into "deepfake" images showing them in revealing clothing.

On social platforms like Reddit, some technical forums (such as the now-banned r/ChatGPTJailbreak) once gathered a large number of users sharing "nudity" tutorials. The report noted that one user uploaded a photo of a woman wearing an Indian traditional garment, the saree, and requested others to "replace" her clothing with a bikini. This request was quickly responded to with fake images generated by other users. Although Reddit removed the content after receiving complaints and banned the subforum with 200,000 members, non-consensual deepfake content targeting women continues to circulate in online dark corners.

In response to this issue, both Google and OpenAI have made statements. A Google spokesperson emphasized that the company has clear policies prohibiting the generation of explicit sexual content and is continuously improving AI models to identify and intercept such requests. OpenAI stated that although it has eased some restrictions on images of non-sexualized adult bodies this year, it strictly prohibits altering others' likenesses without their consent and will take action against violating accounts.

However, with the advancement of AI technology, tools such as Google's newly released Nano Banana Pro and OpenAI's updated image model have made a qualitative leap in realism. Legal experts have expressed deep concerns, believing that while these tools enhance productivity, they also lower the barrier for creating malicious false information. Currently, how to establish a stronger firewall between technological innovation and ethical safety has become a critical challenge for these AI giants.