Legal Action Against Grok
On Thursday, the Netherlands court ruled against Grok in response to a lawsuit filed by The Victim Support Fund and The Offlimits Centre for Expertise, who stated that Grok provides users with AI-created nude images that can also include children, whether by using completely fictitious images or real people's images through deepfake technology. Examples of AI-created nude children were provided, such as images of adult males with underdressed children, which caused the court a great deal of concern about the potential that Grok may assist in promoting male child sexual abuse within the Netherlands.
Legal Responsibility of xAI
According to the court, Grok's owner, xAI, could likely be held responsible for the misuse of the chatbot because they serve as an operator and controller. The court also found that by operating, Grok xAI will need to control the misuse of the chatbot without producing any of those images. The Netherlands restriction will apply to the creation and use of AI-created child images in the Netherlands only, whereas the court would not extend the restriction to users worldwide, despite the request of the Plaintiff.
Company Response
During the hearing, Grok's lawyers stated that the company is committed to preventing the misuse of their chatbot for the exploitation of children, but noted that while there is an expectation that every user will be safely protected from abusers, there will always be some users who will find ways around the current safeguards.




