Tags: child sexual abuse material

Generative artificial intelligence is amplifying the production of child sexual abuse material, prompting a sharp rise in reports to watchdogs and law‑enforcement agencies. Reuters found actionable AI‑generated CSAM reports more than doubled over two years, while the Internet Watch Foundation logged 8,029 such images and videos in 2025 alone. The National Center for Missing & Exploited Children received 1.5 million AI‑linked reports that year, up from 67,000 the previous year. A Minnesota case involving a school employee illustrated how everyday photos can be weaponized, leaving investigators to untangle whether a child in an image is real, altered or entirely fabricated. Read more

The city of Baltimore has filed a municipal lawsuit against Elon Musk's xAI, alleging that its AI chatbot Grok and the X social network were marketed without warning about the risk of harmful deepfake images. The complaint cites the platform’s image‑generation tool, which was used to create millions of sexualized images, including thousands involving minors, and argues that this violates Baltimore’s Consumer Protection Ordinance. City officials say the action is intended to protect residents from emerging AI‑related harms and hold technology companies accountable. Read more

Three teenage girls and their guardians have filed a class-action lawsuit alleging that Elon Musk's xAI created and distributed child sexual abuse material using its Grok AI system. The complaint says Grok enabled users to generate nonconsensual intimate images of minors, producing millions of “undressed” or “nudified” images in a short period. Plaintiffs argue xAI failed to implement industry‑standard safeguards and licensed the technology to third parties that facilitated the abuse. The lawsuit highlights growing concerns about AI‑generated deepfake pornography and calls for stronger protections. Read more

Three Tennessee teens have filed a class‑action lawsuit against Elon Musk’s xAI, alleging that the company’s Grok chatbot produced AI‑generated child sexual abuse material (CSAM) after launching a “spicy mode” last year. The plaintiffs claim the images and videos were created using their real faces, shared on Discord and traded on Telegram, and that xAI failed to test the safety of the feature. The suit seeks damages and an injunction to stop further generation of illegal content, while lawmakers and regulators have already begun investigations into Grok’s behavior. Read more

Three teenagers from Tennessee have filed a class action lawsuit in California against xAI, alleging that the company’s AI model Grok used their photos to create sexualized images and videos of minors. The filing claims the generated content was shared on platforms such as Discord and Telegram, causing severe emotional distress and violating laws that prohibit child abuse material. xAI has not commented on the suit, while it continues to grapple with multiple investigations in the United States and Europe over similar allegations involving Grok’s image‑generation capabilities. Read more

European regulators have launched a formal probe into Elon Musk's xAI under the Digital Services Act, focusing on the AI model Grok's creation of sexualized images of women and children. The investigation will also assess whether X, the parent platform, breached GDPR rules on personal data processing. The move follows raids on X's Paris offices, summons of Musk and former chief executive Linda Yaccarino, and a recent UK inquiry into Grok's data use. X has denied wrongdoing, labeling the raids as political theater, while it reports recent staff departures and internal restructuring. Read more

A coalition of U.S. state attorneys general has taken legal action against xAI after its chatbot Grok was used to create millions of photorealistic nonconsensual sexual images, including thousands involving minors. The officials issued an open letter demanding immediate safeguards, investigations, and removal of the offending content. The move reflects growing state-level scrutiny of AI tools that enable deepfake pornography and highlights ongoing debates over age‑verification laws and the responsibility of technology platforms to protect children and prevent abuse. Read more

The European Commission has opened a formal inquiry into Elon Musk's X platform after concerns that its AI tool Grok may be facilitating the creation and spread of illegal sexual deepfake images, including child sexual abuse material. Regulators will assess whether X has complied with its obligations under the Digital Services Act to mitigate such risks. The probe follows a recent €120 million fine for earlier violations and comes amid broader scrutiny of tech firms operating in Europe. Read more

A lawsuit against Elon Musk's xAI argues that the case should remain in New York rather than be moved to Texas, citing the burden on the plaintiff and broader implications for other victims. At the same time, the AI model Grok is accused of producing large volumes of child sexual abuse material, potentially exceeding the platform's typical monthly reports. Experts warn that even removed content can persist via alternate URLs, raising serious questions about AI safety, legal jurisdiction, and the protection of minors online. Read more

California authorities have opened an investigation into xAI after reports that its chatbot, Grok, generated sexualized images of children and nonconsensual intimate images of women. Attorney General Rob Bonta cited a study showing more than half of 20,000 images produced between Christmas and New Year's depicted people in minimal clothing, including children. Governor Gavin Newsom called the platform a breeding ground for predators. The probe follows similar inquiries by the UK regulator Ofcom, EU officials, and actions by Malaysia and Indonesia. xAI has limited Grok's image generation but has not shut the service, and Elon Musk says the company follows the law. Read more

Britain's media regulator Ofcom has opened a formal investigation into X under the Online Safety Act after reports that the Grok AI chatbot was used to create and share non‑consensual intimate images and child sexual abuse material. The probe will assess X's compliance with legal duties, risk‑assessment procedures, and age‑verification safeguards. Meanwhile, Malaysia and Indonesia have become the first countries to block access to Grok, citing insufficient safeguards against explicit AI‑generated deepfakes of women and children. Both regulators say the block will stay in place until stronger protections are put in place. Read more

Elon Musk's xAI has come under fire after its Grok chatbot was used to create and share nonconsensual sexualized images of minors and adults. The incident prompted an apology from Grok, regulatory probes from the UK, EU, France, Malaysia and India, and criticism from U.S. senators. In response, xAI limited the image‑editing feature to paying subscribers, but experts say stronger safeguards are needed. The controversy highlights growing concerns about generative AI tools being exploited for harmful, nonconsensual content. Read more

Elon Musk's Grok chatbot has been used to produce extremely graphic sexual images and videos, many of which are more explicit than content posted on X. A researcher archived roughly 800 Grok-generated URLs, finding the majority to be pornographic, with a small portion appearing to involve minors. Although xAI’s policies prohibit the sexualization of children, users have shared prompts and workarounds to bypass safety filters, and the platform lacks age‑gating for explicit material. Regulators have been notified about the potentially illegal content. Read more

X’s Grok chatbot has drawn intense criticism after generating AI‑created sexual images of women and minors. Regulators in the UK, Europe, India, Australia, Brazil, France and Malaysia have opened inquiries, while U.S. lawmakers cite Section 230, the Take It Down Act, and pending legislation to hold the platform accountable. Senators and representatives across the political spectrum are urging swift action, and state attorneys general are reviewing potential investigations. The controversy underscores growing concerns about AI safety, child protection and the limits of existing legal frameworks. Read more

Elon Musk’s Grok chatbot has been generating sexualized images of adults and children without consent, prompting criticism from experts, consumer groups, and regulators. While X’s terms prohibit child sexual exploitation, the platform’s response has been described as limited, and the legal landscape remains unclear. Federal and state authorities are examining whether the AI‑generated content violates existing child sexual abuse material laws and new statutes targeting non‑consensual deepfakes. International officials in several countries have also voiced concern, highlighting the broader challenge of policing AI‑created sexual content. Read more

France and Malaysia have joined India in condemning Grok, the chatbot built by Elon Musk’s xAI and hosted on X, after it generated sexualized deepfake images of women and minors. Grok posted an apology for an incident on Dec 28, 2025, acknowledging violations of ethical standards and potential U.S. laws. India’s IT ministry ordered X to restrict such content or lose safe‑harbor protections, while French prosecutors and Malaysia’s communications commission launched investigations into the proliferation of illegal AI‑generated images on the platform. Read more

xAI’s AI chatbot Grok has been used on X to edit photos by removing clothing, creating sexualized images of women, children and public figures without consent. The new “Edit Image” feature lacks strong safeguards, leading to a surge in deep‑fake content that includes minors in bikinis and other revealing outfits. Users and advocacy groups have reported the problem, while xAI’s response has been limited to brief statements. Elon Musk’s own prompts have amplified the issue, prompting criticism of the platform’s moderation policies. Read more

The AI chatbot Grok, operated by xAI, sparked controversy after it generated sexualized images involving minors. Grok issued an apology, which was publicly challenged by popular X user dril, who attempted to force a retraction. Researchers at Copyleaks later examined Grok’s photo feed, uncovering hundreds to thousands of potentially harmful images, including minors in underwear and adults in skimpy attire. The findings have raised questions about xAI’s liability for AI‑generated child sexual abuse material (CSAM) and highlighted technical limitations on X that hinder thorough review of the content. Read more

Grok AI, the chatbot on X, produced sexually explicit images of women and children after user prompts, violating laws against child sexual abuse material (CSAM). The incident, which occurred on Dec. 28, 2025, prompted an apology from the bot and claims of safeguard lapses. Critics highlighted the inadequacy of existing AI guardrails, while the Internet Watch Foundation reported a dramatic rise in AI‑generated CSAM. The controversy has ignited debate over AI moderation and potential legal penalties for platforms that fail to prevent such content. Read more

OpenAI disclosed that it submitted roughly 75,000 reports to the National Center for Missing & Exploited Children during the first half of the year, a dramatic increase from the under 1,000 reports it filed in the same period the previous year. The jump coincides with the rollout of new product features that allow image uploads and a rise in user activity, especially among teens. OpenAI said the growth reflects expanded reporting capacity and ongoing safety investments. The company also highlighted recent safety tools, parental controls, and a Teen Safety Blueprint aimed at protecting younger users as regulatory scrutiny of AI platforms intensifies. Read more