The central government has directed social media platform X to immediately remove and disable all “obscene, nude, indecent and sexually explicit content” being generated and shared through the misuse of artificial intelligence tools like Grok. The order has been issued under the Information Technology Act, 2000 and the IT Rules, 2021, after authorities raised serious concerns about harmful AI-driven content spreading on the platform.
The Ministry of Electronics and Information Technology (MeitY) sent a formal letter to the Chief Compliance Officer of X, asking the company to conduct an urgent and comprehensive review of Grok and take down all unlawful material.
Government Flags Misuse of Grok AI
In its letter, MeitY said it has “especially been observed that the service namely ‘Grok AI’ developed by you and integrated and made available on the X platform is being misused by users to create fake accounts to host, generate, publish or share obscene images or videos of women in a derogatory or vulgar manner in order to indecently denigrate them.”
The ministry warned that such content is not only harmful but also illegal, especially when it targets women and is designed to shame or degrade them using AI-generated material.
Also Read: Grok says safeguard lapses led to images of ‘minors in minimal clothing’ on X
MeitY Blames Platform Safeguards for Failure
The government said the spread of such content shows that X has not put strong safety systems in place. MeitY stated that “such conduct reflects a serious failure of platform-level safeguards and enforcement mechanisms, and amounts to gross misuse of artificial intelligence technologies in violation of applicable laws.”
The ministry made it clear that allowing such content to be created and shared on the platform makes the company responsible for failing to stop its misuse.
Action Taken Report Sought From X
MeitY has now asked X to ensure immediate compliance and stop the hosting, publication, sharing and uploading of obscene and sexually explicit content created through AI services like Grok. The ministry has also demanded an “action taken report” from the company, asking it to explain what steps have been taken to prevent further misuse of the tool.
The government’s order highlights its growing concern about the dangerous and unlawful use of AI on social media, especially when it is used to spread fake and degrading content about women.
