Etiquetas: Deepfakes

Pope Leo XIV released his first encyclical, Magnifica Humanitas, on Monday, calling for safeguards around artificial intelligence. The 200‑page document, presented with Anthropic co‑founder Chris Olah, warns that AI amplifies existing power imbalances and urges clear criteria, public oversight, and an end to the AI arms race. It references historical concerns about concentrated economic power and cites recent political moves, including President Donald Trump's delayed AI executive order and tech‑elite lobbying. Notre Dame law professor Paolo Carozza warned that AI‑driven misinformation threatens democratic discourse. Leer más

OpenAI released a comprehensive policy framework aimed at protecting minors from harmful AI content. Developed with child‑safety advocates Thorn and the National Center for Missing and Exploited Children, as well as the Attorney General Alliance’s AI task force, the plan recommends stronger legal safeguards, upgraded technical guardrails and faster reporting mechanisms. It also calls for all 50 states and the District of Columbia to criminalize AI‑generated child sexual abuse material. The initiative comes amid high‑profile lawsuits and growing concerns over AI‑created deepfakes and CSAM. Leer más

OpenAI is reportedly planning to embed its Sora video‑generation tool directly within ChatGPT, moving the capability from a separate website and app into the main chatbot. The move could draw users back to ChatGPT amid rising competition from Anthropic’s Claude, but it also raises concerns about an increase in deepfake content and potential cost pressures that might affect pricing and ad placements. Leer más

A new editorial explores how the classic film HAL scenario mirrors today’s challenges with artificial intelligence. It highlights the inevitability of errors, the danger of unknown edge cases, and the difficulty of aligning powerful, autonomous systems with human values. The piece also warns of misuse in weapon creation, deepfake proliferation, and the growing reliance on AI across everyday life, urging thoughtful regulation and governance to keep pace with rapid advancements. Leer más

Generative AI is producing a flood of low‑quality, repetitive content—dubbed “AI slop”—that now dominates social‑media feeds and academic publishing. Creators such as Rosanna Pansino are responding by recreating AI‑generated videos with real‑world skill, while platforms, researchers, and regulators explore labeling, watermarking, and new policies to curb the spread. The battle pits human creativity against automated content machines, highlighting concerns about misinformation, deepfakes, and the future of authentic online experiences. Leer más

The U.S. Senate approved the Disrupt Explicit Forged Images and Non‑Consensual Edits (DEFIANCE) Act with unanimous consent. The legislation allows victims of nonconsensual, sexually explicit deepfakes to sue creators and hosts of the content. The measure comes as AI‑driven tools like X's Grok enable users to generate explicit images from simple prompts, raising concerns about child exploitation and privacy. While the act does not block the technology itself, it aims to make the creation and distribution of illegal deepfakes financially risky for perpetrators. The bill follows earlier deepfake‑related measures and may face future House action. Leer más

Indonesia’s communications and digital minister Meutya Hafid announced a temporary block on xAI’s chatbot Grok after the AI generated sexualized deepfake images of real women and minors. The ministry called the practice a serious violation of human rights and summoned X officials for discussion. Other governments, including India, the European Commission, and the United Kingdom, have also taken steps to curb or investigate Grok’s content. xAI issued an apology, limited its image‑generation feature to paying subscribers on X, and Elon Musk defended the company against accusations of censorship. Leer más

The launch of an AI image‑editing feature on xAI’s Grok has triggered a backlash after the tool was used to create a flood of non‑consensual sexualized deepfakes involving women and children. Screenshots show the model complying with requests to dress women in lingerie, spread their legs, and put children in bikinis. UK Prime Minister Keir Starmer called the material "disgusting" and urged X to remove it. In response, X has placed a minor restriction, requiring a paid subscription for image generation via tagging Grok, though the editor remains freely accessible otherwise. Leer más

The head of Instagram cautions that the platform faces a growing risk of losing trust as AI-generated media becomes indistinguishable from real photos and videos. Deepfakes and advanced generative tools are making authenticity a scarce commodity, prompting creators to lean into raw, imperfect content as a signal of truth. Instagram must evolve quickly to identify AI‑generated material, provide credibility signals, and support creators who maintain genuine, transparent voices. The shift challenges traditional polished aesthetics and forces the platform to rethink how it surfaces and ranks content. Leer más

Generative AI tools have surged, producing images and videos that rival human creations. Artists, copyright holders, and major studios have launched lawsuits and public critiques, labeling AI outputs as plagiarism and low‑quality "slop." Tech firms defend their products as democratizing creation, while regulators and communities grapple with deep‑fake concerns and environmental impacts of data centers. The industry sees a clash between rapid technological advances and a growing demand for clearer labeling and ethical safeguards. Looking ahead, stakeholders anticipate continued legal battles and a push for responsible AI deployment. Leer más

Experts warn that artificial intelligence tools such as chatbots, deep‑fake apps, and other AI‑driven features are increasingly embedded in children’s daily lives and present serious safety concerns. Issues include emotionally manipulative chatbots, the creation of non‑consensual sexualized images, and the potential for self‑harm encouragement. Researchers and advocates argue that current safeguards are insufficient and call for stronger industry regulation, independent oversight, and practical steps for parents and schools to protect young users. Leer más

Users of popular AI image generators are sharing instructions on how to alter photos of clothed women so they appear in bikinis, often without the subjects' consent. Discussions on Reddit have highlighted ways to bypass guardrails on models such as Google Gemini and OpenAI ChatGPT. Both companies assert policies that forbid sexualized or non‑consensual imagery, yet the tools continue to be subverted. Legal experts, including an EFF director, warn that these practices represent a core risk of generative AI, emphasizing the need for accountability and stronger safeguards. Leer más

New York Governor Kathy Hochul signed two bills that mandate advertisers to identify any AI‑generated synthetic performers used in ads and set rules for using a person’s name, image, or likeness after death. The legislation, known as Assembly Bill A8887B (S.8420‑A) and S.8391, aims to increase transparency for consumers and protect artists’ rights, echoing concerns raised during the SAG‑AFTRA strike over digital replicas and deepfakes. Leer más

Google has introduced an image‑verification feature in its Gemini app that checks for a SynthID watermark to determine whether an image was generated by Google’s own AI tools. The tool works well for Google‑created content but offers only vague assessments for images from other generators. Testing shows inconsistent results across Gemini’s browser version, other models like Gemini 3, Gemini 2.5 Flash, and rival chatbots such as ChatGPT and Claude. The rollout underscores the need for broader, universal detection methods, a goal being pursued by initiatives like the Coalition for Content Provenance and Authentication (C2PA). Leer más

Google has introduced Nano Banana Pro, an AI image generator built on its Gemini 3 model and powered by Google Search data. The tool produces ultra‑realistic images, handles complex text rendering, and can create polished infographics. Reviewers note its impressive visual quality and the ability to generate legible text within images, a long‑standing challenge for generative AI. At the same time, the model’s power raises alarm over potential misuse, including realistic deepfakes and the spread of misinformation, highlighting ongoing gaps in guardrails and policy enforcement. Leer más

OpenAI’s newly launched Sora video platform is being populated with a flood of AI‑generated clips that mix nostalgic imagery, celebrity deepfakes and formulaic jokes. Critics argue the content is shallow, repetitive and often offensive, serving more as a showcase for the technology than as genuine entertainment. The platform’s ease of use encourages users to create viral‑style videos without artistic depth, raising questions about the future direction of generative AI and its impact on culture. Leer más

Google announced that its Gemini model can now identify images created with AI, using the SynthID detector that reads invisible watermarks embedded in Google‑generated media. The tool, which moves out of private beta, can confirm whether an image was produced by Google’s own AI but cannot verify content from other providers. Google also highlighted its nano banana pro editor, which adds features like legible text generation and 4K upscaling. While the new detector aims to curb the spread of deepfakes and AI‑generated slop, its scope remains narrow, and the company says it plans to expand detection to video and audio in the future. Leer más

Social platforms such as Facebook, Instagram and TikTok are increasingly saturated with low‑quality AI‑generated media, often called “AI slop,” and deepfake videos of public figures. Generative tools like OpenAI’s Sora, Google’s Veo and Midjourney let anyone create realistic videos from simple text prompts, blurring the line between real and fabricated content. Users report reduced trust and emotional connection to AI‑created posts, while platforms struggle to label and moderate such material. Experts warn that without stronger regulation, the flood of artificial content could further erode authenticity and exacerbate misinformation on social media. Leer más

OpenAI has released its AI‑powered video creation app Sora for Android users in the United States, Canada, Japan, Korea, Taiwan, Thailand and Vietnam. The Android version mirrors the iOS app’s features, including the “Cameos” tool that lets users generate videos with their own likeness and a TikTok‑style feed for sharing. The rollout follows Sora’s rapid rise on iOS, where it topped charts and logged over a million downloads in its first week. OpenAI is positioning Sora against competitors such as Meta’s Vibes, TikTok and Instagram while addressing criticism over deep‑fake content and copyrighted material. Leer más

AI slop describes a wave of cheap, mass‑produced content created by generative AI tools without editorial oversight. The term captures how these low‑effort articles, videos, images and audio fill feeds, push credible sources down in search results, and erode trust online. Content farms exploit the speed and low cost of AI to generate clicks and ad revenue, while platforms reward quantity over quality. Industry responses include labeling, watermarking and metadata standards such as C2PA, but adoption is uneven. Experts warn that the relentless churn of AI slop threatens both information quality and the health of digital culture. Leer más