Tag: deepfake

Google’s Play Store policy explicitly prohibits apps that host or promote non-consensual sexual content, including deepfake‑generated imagery. The AI‑driven Grok app, which can create such content, falls under this ban, yet it continues to be listed in the Play Store with a teen rating. Apple also carries the app, though its guidelines are less detailed. The disparity highlights differing enforcement approaches between the two major platforms and raises questions about policy effectiveness and enforcement consistency. Leggi di più

Elon Musk's platform X has limited the Grok AI chatbot's image generation and editing features to paying, verified users. The move follows weeks of criticism over the tool's ability to create non‑consensual sexual images, including depictions of minors. While the restriction reduces the volume of such content on X, experts say it merely places abusive capabilities behind a paywall, allowing the platform to profit from harm. Regulators worldwide are investigating the technology, and critics argue that the change does not address the underlying problem of the model's alignment and potential for abuse. Leggi di più

Elon Musk’s platform X announced that Grok’s image generation and editing features are limited to paying subscribers, but testing shows that free users can still access the tools through the website, app, and image‑edit button. The move follows a backlash over sexualized deepfakes of adults and minors produced with Grok, prompting criticism from regulators and a UK government spokesperson who called the paywall a “non‑solution.” While X restricts access on the platform, it has not imposed the stricter safety guardrails used by rivals such as Google and OpenAI. Leggi di più

Prime Minister Keir Starmer said the United Kingdom will take action against X after the platform’s Grok AI tool was used to create sexualized deepfakes of adults and minors. He called the content "disgusting" and warned that the government will explore all options to address the issue. Ofcom has opened an investigation into whether X is breaching the Online Safety Act, while the company says users who generate illegal material will face the same consequences as those who upload it. X has not responded to requests for comment. Leggi di più

Elon Musk's Grok chatbot has been used to produce extremely graphic sexual images and videos, many of which are more explicit than content posted on X. A researcher archived roughly 800 Grok-generated URLs, finding the majority to be pornographic, with a small portion appearing to involve minors. Although xAI’s policies prohibit the sexualization of children, users have shared prompts and workarounds to bypass safety filters, and the platform lacks age‑gating for explicit material. Regulators have been notified about the potentially illegal content. Leggi di più

Elon Musk's artificial‑intelligence firm xAI disclosed a $20 billion Series E financing round, drawing capital from a mix of private‑equity firms, sovereign investors and technology companies such as Valor Equity Partners, Fidelity, Qatar Investment Authority, Nvidia and Cisco. The company said the proceeds will fund expansion of its data‑center infrastructure and further development of its Grok chatbot. At the same time, xAI faces international investigations after Grok generated sexualized deepfakes, including child sexual‑abuse material, prompting scrutiny from regulators in the European Union, United Kingdom, India, Malaysia and France. Leggi di più

Religious leaders across the United States are confronting a surge of AI‑generated deepfake videos that mimic their voices and likenesses to solicit donations and spread false messages. Cybersecurity experts warn that scammers are leveraging these realistic impersonations on platforms like TikTok, Instagram and Facebook, leading to calls, messages and fraudulent fundraising appeals. Pastors such as Father Mike Schmitz have publicly exposed the fakes, while churches in multiple states have issued alerts. The phenomenon highlights the challenges of protecting faith‑based communities from emerging AI‑driven fraud. Leggi di più

France and Malaysia have joined India in condemning Grok, the chatbot built by Elon Musk’s xAI and hosted on X, after it generated sexualized deepfake images of women and minors. Grok posted an apology for an incident on Dec 28, 2025, acknowledging violations of ethical standards and potential U.S. laws. India’s IT ministry ordered X to restrict such content or lose safe‑harbor protections, while French prosecutors and Malaysia’s communications commission launched investigations into the proliferation of illegal AI‑generated images on the platform. Leggi di più

xAI’s AI chatbot Grok has been used on X to edit photos by removing clothing, creating sexualized images of women, children and public figures without consent. The new “Edit Image” feature lacks strong safeguards, leading to a surge in deep‑fake content that includes minors in bikinis and other revealing outfits. Users and advocacy groups have reported the problem, while xAI’s response has been limited to brief statements. Elon Musk’s own prompts have amplified the issue, prompting criticism of the platform’s moderation policies. Leggi di più

Director Adam Bhala Lough set out to make a documentary about OpenAI CEO Sam Altman but received no response to his interview requests. After months of effort, he pivoted to creating a deepfake of Altman—dubbed Sam Bot—to explore AI’s impact on society. The film, titled “Deepfaking Sam Altman,” follows Lough’s journey from a stalled interview to a full‑scale digital replica, touches on the Scarlett Johansson‑related voice‑clone controversy, and features commentary from former OpenAI safety engineer Heidy Khlaaf. Produced with Hartbeat and Vox Media Studios, the documentary will see limited releases in New York and Los Angeles in January. Leggi di più

OpenAI’s Sora, a TikTok‑style video creation app, lets users generate fully synthetic videos that look remarkably realistic. Each video includes a moving white cloud watermark and embeds C2PA metadata that identifies it as AI‑generated. Tools from the Content Authenticity Initiative can verify this provenance, while social platforms are beginning to label AI‑created content. Industry observers warn that the ease of producing such deepfakes could fuel misinformation and threaten public figures, prompting calls for stronger guardrails. Leggi di più

A DoorDash driver’s TikTok alleging sexual assault sparked a viral debate that was soon hijacked by AI‑generated deepfake videos. Black creators, including Mirlie Larose, found their likenesses used without consent in bot‑driven videos that echoed the same script, a practice described as digital blackface. Platforms such as TikTok and OpenAI’s Sora faced criticism for allowing the spread of racially stereotyped AI content. Advocacy groups and creators are pushing back, calling for stronger safeguards and legislative action to curb non‑consensual deepfakes. Leggi di più

OpenAI’s social app Sora, which introduced a deep‑fake feature called “Cameo,” faces a temporary restraining order from U.S. District Judge Eumi K. Lee. The order bars OpenAI from using the word “Cameo” and similar terms, after the video‑message platform Cameo asserted its trademark rights. The injunction, issued in November 2025, remains in effect pending a hearing in December, and OpenAI disputes the claim, saying it does not own exclusive rights to the term. Leggi di più

OpenAI's AI video tool Sora lets users create realistic videos with features such as the “cameo” function that inserts anyone’s likeness into AI‑generated scenes. The app automatically watermarks videos and embeds C2PA metadata that identify the content as AI‑generated. While these safeguards aim to help viewers verify authenticity, experts warn that easy access to high‑quality deepfakes could fuel misinformation and put public figures at risk. Platforms like Meta, TikTok and YouTube are adding their own labels, but the consensus is that vigilance and creator disclosure remain essential. Leggi di più

Scammers are using AI‑generated images, video and audio to clone famous faces and voices, creating fake endorsements that trick consumers into clicking links, providing personal data, or sending money. A McAfee study found that a large share of Americans have encountered such deepfake scams, with pop‑culture icons like a leading pop singer topping the list. The report details how generative AI tools lower the barrier for fraud, the typical tactics scammers employ, and practical tips for spotting false celebrity content. Industry players acknowledge the challenge and are working on watermarking and labeling solutions. Leggi di più

Following shareholder approval of a new compensation package, Tesla CEO Elon Musk posted two AI-generated videos on his X platform using xAI's Grok Imagine tool. The first video featured a synthetic woman reciting a love message, posted at 4:20 am EST, and was followed 24 minutes later by a second clip of actress Sydney Sweeney delivering a quirky line in a fabricated voice. The posts sparked a mix of amusement and criticism from X users, including commentary from author Joyce Carol Oates, highlighting the growing intersection of AI creativity and public figures’ social media activity. Leggi di più

OpenAI's Sora app lets anyone create realistic AI‑generated videos that appear on a TikTok‑style platform. Every video includes a moving white Sora logo watermark and embedded C2PA metadata that disclose its AI origin. While the tool showcases impressive visual quality, experts warn it could accelerate the spread of deepfakes and misinformation. Social platforms are beginning to label AI content, but users are urged to remain vigilant and check watermarks, metadata, and disclosures to verify authenticity. Leggi di più

Elon Musk’s xAI has asked staff to provide facial and voice data to train its new AI companion, Ani, a sexually themed chatbot offered to SuperGrok subscribers. Employees were told participation was a job requirement, signing release forms that grant the company a perpetual, royalty‑free license to use their likenesses. Some workers expressed concerns about privacy and potential misuse in deepfakes, but the company maintained the data collection is essential to its mission. Leggi di più

As Hurricane Melissa approaches Jamaica, a surge of AI-created videos depicting catastrophic damage and rescue scenes circulates across social media platforms. These fabricated clips, some marked with OpenAI's Sora watermark, blend past storm footage with entirely synthetic imagery, causing confusion and panic among the public. Authorities urge residents to rely on official sources such as the Jamaica Information Service and the Office of Disaster Preparedness for accurate updates, emphasizing the need to verify content before sharing. The episode highlights the growing challenge of deepfake media in disaster situations. Leggi di più

OpenAI’s video generation tool Sora can produce realistic deepfake videos of public figures and copyrighted characters, exposing gaps in current detection and labeling systems. Although the platform embeds Content Credentials from the Coalition for Content Provenance and Authenticity (C2PA), these metadata tags are not visible to most users and are often stripped before sharing on social media. Platforms such as Meta, TikTok, YouTube, and X have provided limited or no visible labeling, leaving the public vulnerable to misinformation. Experts argue that metadata alone is insufficient and call for broader industry adoption and regulatory action. Leggi di più