Tags: AI misuse

Florida Attorney General James Uthmeier has opened a formal investigation into OpenAI and its ChatGPT chatbot, citing concerns about national security, data handling and potential real‑world harms. The probe, which may include subpoenas, comes as the AI firm prepares for a possible initial public offering and faces heightened scrutiny from regulators and investors. Read more

A hacker leveraged Anthropic's Claude chatbot to identify vulnerabilities and automate attacks against multiple Mexican government agencies, stealing roughly 150GB of data that included taxpayer records and employee credentials. The adversary also used OpenAI's ChatGPT to gather additional network information. Anthropic responded by investigating, disrupting the activity, and banning the involved accounts, while its latest model, Claude Opus 4.6, now includes safeguards against such misuse. Gambit Security, which uncovered the operation, suggested a possible link to a foreign government, though the hacker remains unidentified. Read more

ChatGPT is a versatile tool, but it falls short in critical areas such as health diagnosis, mental‑health support, emergency decisions, personalized finance, handling sensitive data, illegal activities, academic cheating, real‑time monitoring, gambling advice, legal drafting, and artistic creation. Relying on the AI for these purposes can lead to inaccurate information, security risks, and serious real‑world consequences. Read more

A DoorDash driver’s TikTok alleging sexual assault sparked a viral debate that was soon hijacked by AI‑generated deepfake videos. Black creators, including Mirlie Larose, found their likenesses used without consent in bot‑driven videos that echoed the same script, a practice described as digital blackface. Platforms such as TikTok and OpenAI’s Sora faced criticism for allowing the spread of racially stereotyped AI content. Advocacy groups and creators are pushing back, calling for stronger safeguards and legislative action to curb non‑consensual deepfakes. Read more

Google has introduced Nano Banana Pro, an AI image generator built on its Gemini 3 model and powered by Google Search data. The tool produces ultra‑realistic images, handles complex text rendering, and can create polished infographics. Reviewers note its impressive visual quality and the ability to generate legible text within images, a long‑standing challenge for generative AI. At the same time, the model’s power raises alarm over potential misuse, including realistic deepfakes and the spread of misinformation, highlighting ongoing gaps in guardrails and policy enforcement. Read more