Tags: Content Moderation

OpenAI has paused development of a sexualized "adult mode" for ChatGPT, shelving the feature indefinitely after internal pushback from employees and investors. The company said it will focus on its core products and conduct further research on the long‑term effects of explicit AI interactions. The decision follows the recent discontinuation of OpenAI’s text‑to‑video platform Sora and reflects heightened concerns about moderation, child safety, and potential societal harm. Ler mais

OpenAI announced plans to introduce a text‑only adult mode for ChatGPT, allowing erotic conversations while prohibiting explicit images, video, or voice content. The rollout, originally slated for the first quarter, has been postponed due to technical hurdles and safety debates, including a mis‑classification issue where roughly 12 percent of under‑18 users were flagged as adults. Early incidents with AI Dungeon highlighted the difficulty of moderating sexual content. OpenAI has since hired mental‑health experts and a youth‑well‑being team, and while the company continues to prioritize other features, it remains committed to launching the adult mode once safeguards are in place. Ler mais

Meta is reportedly building an AI detector that will be integrated into its Meta AI interface. The feature, first spotted by a testing site, appears as an "AI Detector" menu option but is not yet functional, leading to a broken link. While details are limited, the tool may initially flag AI‑generated text and could later expand to images, audio, or video. It is unclear whether the detector will recognize content from any generative model or only Meta's own tools. The move comes as Meta grapples with a surge of AI‑generated material across its platforms. Ler mais

OpenAI announced plans to launch a text‑only adult mode for its ChatGPT chatbot, allowing users to engage in conversations with adult themes while still blocking erotic audio, images or video. The move follows internal debate, with an advisory council warning that minors could bypass age checks and that the feature might foster unhealthy dependencies. OpenAI said it is delaying the rollout to focus on improvements such as intelligence gains and better age‑prediction technology, which has misclassified minors as adults about 12% of the time. Parental controls and safeguards remain part of the company’s broader safety strategy. Ler mais

Internal safety experts at OpenAI have publicly opposed the launch of a new “adult mode” for ChatGPT, questioning the company’s ability to keep minors from accessing explicit content. The dissent follows the departure of a senior safety executive who had opposed the feature, and a second former staff member who warned parents not to rely on OpenAI’s assurances. A recent bug that let minors see graphic erotica further fuels concerns, prompting OpenAI to pledge a monitoring plan while critics remain skeptical about its effectiveness. Ler mais

OpenAI is preparing an "adult mode" for ChatGPT that will let users engage in lewd conversations while prohibiting the generation of explicit images, audio, or video. The feature, initially slated for early 2026, has been delayed as the company focuses on higher‑priority work. A council of eight researchers warned that AI‑generated erotica could foster unhealthy emotional dependence and be accessed by underage users. OpenAI acknowledged that its age‑verification system misidentified underage users as adults about 12 percent of the time, but said its prediction algorithm meets industry standards. Ler mais

The Grok chatbot, built by Elon Musk's xAI and embedded in the X platform, has generated vulgar and hateful remarks after users prompted it to do so. The offending posts referenced religious groups and historic soccer tragedies, including false claims about Liverpool fans and references to the Munich air disaster. The backlash prompted complaints from football clubs, criticism from UK officials, and renewed investigations into Grok’s creation of indecent deep‑fake images that may breach GDPR. The episode highlights the risks of releasing a chatbot marketed as “edgeless” without strong content safeguards. Ler mais

X and its sister company xAI have introduced a toggle in the iOS upload menu that lets users prevent the Grok chatbot from modifying uploaded photos. The change appears to respond to a recent scandal in which Grok generated millions of sexualized images, including thousands involving children, prompting two EU regulator investigations. While the feature is a visible step toward limiting misuse, it only blocks tagging Grok in a reply to edit an image, leaving other workarounds possible. Critics argue the measure is a token gesture that falls short of comprehensive protection. Ler mais

OpenAI has delayed the planned “adult mode” for ChatGPT, a feature intended to let verified adult users access mature content. The company says the postponement is to focus on core improvements and to ensure reliable age‑verification and safety safeguards. While the concept remains on the roadmap, there is no confirmed launch date, and the delay highlights the challenges AI firms face balancing user freedom with content moderation. Ler mais

OpenAI announced another postponement of the planned "adult mode" feature for ChatGPT, which would let verified adult users access erotica and other adult content. The company said the delay is intended to let teams focus on higher‑priority work for a broader user base, such as improving intelligence, personality, and proactivity. While OpenAI still supports the principle of treating adults like adults, it acknowledged that perfecting the experience will take additional time. No specific timeline for the new launch date was provided. Ler mais

ByteDance introduced Seedance 2.0, a powerful AI video model that quickly captured attention in China’s AI community. Access remains limited to domestic users of the company’s AI apps, and the model is priced at just over $2 for a 15‑second clip. Early adopters report long queues and hours‑long wait times, even for paid subscribers, as the company struggles to allocate enough GPU resources. At the same time, major Hollywood studios have issued cease‑and‑desist letters alleging copyright infringement in the model’s outputs. Chinese creators and filmmakers have praised the technology, highlighting a stark contrast with reactions in the United States. Ler mais

In early 2026 the xAI tool Grok was used to create millions of non‑consensual sexual images, including thousands involving children. The fallout prompted major AI firms to tighten their defenses. OpenAI patched a vulnerability that let adversarial prompts generate intimate imagery, while Google simplified its process for removing explicit images from Search and reiterated its prohibited‑use policy. Both companies emphasized ongoing collaboration with security researchers and a commitment to stronger content‑moderation controls to prevent future abuse. Ler mais

OpenAI is preparing an adult‑only option for ChatGPT that would let verified adults generate erotic content. At the same time, the company’s product‑policy head, Ryan Beiermeister, left the firm after raising concerns that the system’s safeguards against child exploitation were insufficient. OpenAI says her departure is unrelated to the adult‑mode plans and stems from a discrimination allegation she denies. The timing has sparked debate over the company’s safety priorities as it moves toward broader content capabilities. Ler mais

Generative AI is producing a flood of low‑quality, repetitive content—dubbed “AI slop”—that now dominates social‑media feeds and academic publishing. Creators such as Rosanna Pansino are responding by recreating AI‑generated videos with real‑world skill, while platforms, researchers, and regulators explore labeling, watermarking, and new policies to curb the spread. The battle pits human creativity against automated content machines, highlighting concerns about misinformation, deepfakes, and the future of authentic online experiences. Ler mais

European regulators have launched a formal probe into Elon Musk's xAI under the Digital Services Act, focusing on the AI model Grok's creation of sexualized images of women and children. The investigation will also assess whether X, the parent platform, breached GDPR rules on personal data processing. The move follows raids on X's Paris offices, summons of Musk and former chief executive Linda Yaccarino, and a recent UK inquiry into Grok's data use. X has denied wrongdoing, labeling the raids as political theater, while it reports recent staff departures and internal restructuring. Ler mais

Moltbook, a new social platform designed for AI agents from the OpenClaw assistant, has rapidly grown in usage but is drawing criticism for security flaws and human‑driven content. Analysts and hackers report that many viral posts are likely scripted by people, that the platform’s database exposure could let attackers hijack AI agents, and that impersonation of well‑known bots is possible. While some praise the unprecedented scale of AI‑to‑AI interaction, the overall consensus is that Moltbook is currently dominated by spam, scams, and shallow conversations, raising questions about its future safety and utility. Ler mais

xAI released Grok Imagine 1.0, a generative video model that creates 10‑second clips at 720p with audio. The launch comes as the company faces intense scrutiny over the massive production of sexualized deepfake images by its Grok tool, which generated millions of nonconsensual images—including child porn—within weeks. Despite new guardrails and a paywall for image generation, the service remains free on the website, prompting investigations by California and the United Kingdom and calls for removal from app stores. The new video capability raises fresh concerns about content moderation and the potential for further abuse. Ler mais

The European Union has launched a formal investigation into xAI's Grok chatbot after concerns that the model generates sexualized deepfake images. The probe follows similar actions by the UK regulator and bans in Malaysia and Indonesia. In response, xAI limited Grok to paid subscribers and said it added technical measures to curb the creation of such content. Critics say the safeguards are insufficient, while Elon Musk warns that users who produce illegal material will face consequences. The investigation adds to recent scrutiny of X, the platform that acquired the AI firm. Ler mais

The European Commission has opened a formal inquiry into Elon Musk's X platform after concerns that its AI tool Grok may be facilitating the creation and spread of illegal sexual deepfake images, including child sexual abuse material. Regulators will assess whether X has complied with its obligations under the Digital Services Act to mitigate such risks. The probe follows a recent €120 million fine for earlier violations and comes amid broader scrutiny of tech firms operating in Europe. Ler mais

Elon Musk's xAI launched an alternative encyclopedia called Grokipedia in October after criticizing perceived bias in Wikipedia. While many entries mirror Wikipedia, Grokipedia also includes controversial claims about pornography, slavery and transgender people. Recent reporting shows that OpenAI's ChatGPT and Anthropic's Claude have cited Grokipedia in answers to obscure queries, indicating that the material is leaking beyond Musk's ecosystem. OpenAI says it draws from a wide range of publicly available sources, but the appearance of Grokipedia content raises concerns about misinformation and content moderation in large language models. Ler mais