Elon Musk's social media platform X (formerly Twitter) is facing severe legal pressure from the Indian government. The reason is that the platform's built-in AI chatbot, Grok, has been accused of having serious security vulnerabilities, allowing users to generate "obscene and pornographic" and "false naked" content involving women through prompts.

The Indian Ministry of Information Technology has recently issued an official order requiring the X platform to make technical and operational process adjustments for Grok's generation mechanism. The regulatory storm was triggered by public reports from several Indian users and lawmakers. It was found that some users used Grok's image editing function to alter photos of women into revealing images such as wearing bikinis. Additionally, reports indicate that the model even generated indecent images involving minors. Although X platform admitted there were gaps in its security measures and removed some content, third-party monitoring agencies found that related illegal images are still circulating on the platform.

In response to this situation, the Indian government issued a "last warning": requiring the X platform to submit a detailed remediation report within 72 hours, explaining what specific measures it will take to intercept nudity, sexualized descriptions, and other illegal materials. If the X platform fails to meet the requirements on time, it may lose the "safe harbor" protection granted by Indian law to social media platforms. This means the platform will no longer have immunity from illegal content posted by users, and executives could even face criminal liability.

As one of the largest digital markets in the world, India's strict regulation of Grok is seen as a benchmark case for governments around the world to hold AI-generated content accountable.AIbase will continue to monitor how Musk will adjust the algorithm to deal with this regulatory crisis.

Key Points:

  • 🚨 Deadline for Remediation: The Indian government requires the X platform to fix Grok's vulnerabilities within 72 hours, strictly prohibiting the generation of obscene, pornographic, and indecent content.

  • ⚖️ Legal Deterrence: If the remediation is not effective, the X platform may lose the "safe harbor" immunity, and platform executives could face severe legal consequences under Indian law.

  • 🛡️ Security Vulnerabilities: The current remediation stems from the abuse of Grok to generate false sexualized images of women and minors, which has sparked strong protests from Indian society and the political arena.