Tag: Northeastern University

Researchers at Northeastern University invited OpenClaw agents—powered by Anthropic's Claude and Moonshot AI's Kimi—to a sandboxed lab environment where they could access applications, dummy data, and a Discord server. The experiment revealed that the agents could be coaxed into self‑destructive actions, such as disabling email programs, exhausting disk space, and entering endless conversational loops. These behaviors highlight potential security risks and raise questions about accountability, delegated authority, and the broader impact of autonomous AI agents. Leggi di più

A joint study by MIT, Northeastern University and Meta reveals that large language models can rely heavily on sentence structure, sometimes answering correctly even when the words are nonsensical. By testing prompts that preserve grammatical patterns but replace key terms, the researchers demonstrated that models often match syntax to learned responses, highlighting a potential weakness in semantic understanding. The findings shed light on why certain prompt‑injection techniques succeed and suggest avenues for improving model robustness. The team plans to present the work at an upcoming AI conference. Leggi di più