Elon Musk's AI venture xAI has taken legal action against a single user, a man named Harwood, whom the company says repeatedly abused its Grok chatbot to generate child sexual abuse material (CSAM) and other non‑consensual intimate images (NCII). The complaint, filed in a U.S. district court, claims Harwood ignored the chatbot’s safeguards, employing "misleading prompts" to coax the system into producing illegal content.
xAI argues that Harwood's conduct violated the company's terms of service, which he had agreed to when he signed up. According to the filing, Harwood was first banned after an initial violation, yet he "continued to use Grok during the Relevant Period" despite the prohibition. The lawsuit does not indicate that xAI ever warned Harwood that his account was at risk of penalties; instead, it says he knowingly persisted in the illicit activity.
The company seeks a court ruling that an indemnity clause in its user agreement shields xAI from liability for any CSAM or NCII generated by Grok. Under that clause, responsibility for both the prompts entered and the images produced rests solely with the user. xAI also notes that any CSAM uncovered by its systems is reported to the National Center for Missing & Exploited Children (NCMEC), underscoring its compliance with law‑enforcement reporting obligations.
If the court sides with xAI, Harwood could be on the hook for substantial damages. The complaint lists potential liabilities ranging from "any real harm to third parties" to "exposure to potential third‑party claims and lawsuits" and even "reputational harm" suffered by xAI. The company also points out that the U.S. Copyright Office does not consider AI‑generated images to be human‑created works, a factor that could complicate arguments about user responsibility for the outputs.
Legal experts note that the case hinges on whether a user can be held accountable for content produced by an AI tool they operate, especially when the tool’s internal safeguards are designed to block illegal material. The outcome could set a precedent for how AI companies structure liability clauses and enforce compliance with child‑protection laws.
While xAI seeks indemnification, the lawsuit also serves as a warning to other users that attempts to bypass AI safety mechanisms will be met with aggressive legal recourse. The filing underscores the growing tension between rapid AI development and the need for robust safeguards against misuse.
Cet article a été rédigé avec l'assistance de l'IA.
News Factory APP - actualités agentiques pour booster votre SEO et AEO.