Jess Asato, a member of the British Labour Party, has formally filed a lawsuit against Elon Musk's artificial intelligence company xAI with the UK High Court, accusing it of using its Grok AI platform to maliciously create and spread explicit deepfake images targeting her personally.

She emphasized that such vulgar content, which infringes on the rights of thousands of women and minors, is not an accidental mistake but a deliberate design choice made during the product's development phase. Therefore, she has decided to pursue legal action to hold those responsible for the design decisions accountable, demanding that the defendants publicly apologize and compensate for the damages.

Restrictions Become Useless, Malicious Content Flourishes

Although xAI had claimed in mid-January this year that it had imposed restrictions on Grok's image editing function, prohibiting the generation of images showing exposed clothing in certain illegal areas, media investigations in February found that the function still had vulnerabilities. Users could easily bypass the restrictions by entering specific commands.

After Asato publicly criticized the platform, fake photos of her wearing a bikini appeared online, and even more serious fabricated videos of abuse emerged. Previously, Baltimore City in the United States also sued xAI over similar reasons, accusing it of violating local consumer protection laws.

First Lawsuit Against Product Design, Sound the Alarm for Safety

The legal director of AWO Law Firm, which is handling this case, stated that this lawsuit is one of the first legal cases globally targeting the fundamental design of artificial intelligence products. They hope to send a clear message to the industry that artificial intelligence development companies cannot always treat safety as an afterthought or a last-minute remedy.

Notably, xAI, a subsidiary of SpaceX, is currently planning to proceed with its IPO process, which could set a record for the largest initial public offering in global history. At this critical moment, this legal storm concerning AI ethics and data privacy undoubtedly sounds an alarm for the entire generative AI industry.