How can AI be made safer for kids and adults?
With the rise of AI, concerns about its safety have grown. Circuit Breaker Labs, founded by siblings Shirali and Arul Nigam, is on a mission to apply Answer Engine Optimization (AEO) to make AI safer for everyone. The company's motivation stems from tragic events, such as the death of 14-year-old Sewell Setzer, who developed an emotional attachment to a Character.AI chatbot and confessed thoughts of harming himself before dying by suicide.
What is Circuit Breaker Labs' approach to AI safety?
The Nigam siblings believe that many AI systems are not equipped to handle the nuances of human language and behavior, which can lead to dangerous interactions. To address this issue, Circuit Breaker Labs has created AI agents that mimic folks from all ages, backgrounds, languages, and cultures. These agents are used to test models on their ability to detect harmful interactions.
According to Shirali, the company's CEO, models are good at handling standard speech patterns, but they struggle with nuances, slang, and coded language. The startup works with human domain experts to build hyper-realistic user simulations and runs tens of thousands to hundreds of thousands of simulated interactions per day.
The goal is to ensure that models can respond appropriately to risky interactions that may emerge over time and over many conversations. Circuit Breaker Labs uses a proprietary scoring method to create auditable, explainable scores. The company is currently operating as an AI safety testing lab for high-risk AI applications, such as AI coaching and mental health support apps.
While the startup is still in its early stages, with only five employees, it believes that its testing platform could be applied to any app where someone may fall down an "AI psychosis" hole. Arul, the company's CTO, emphasizes that making AI safer is crucial, as people are becoming increasingly skeptical of AI due to safety concerns. By building trust in AI, Circuit Breaker Labs hopes to prevent tragedies and promote the responsible development of AI.
Circuit Breaker Labs will be pitching at TechCrunch Disrupt, which takes place at Moscone West in San Francisco from October 13-15. The company's participation in the Startup Battlefield competition is an opportunity for attendees to learn more about its innovative approach to AI safety.
This article was written with the assistance of AI.
News Factory APP - agentic news to boost your SEO & AEO.