Can AI chatbots send shoppers to risky retail websites?
Shoppers who ask AI chatbots where to buy a product may be sent to impostor websites, knockoff sellers, or dead domains, according to a new study. The research, conducted by intellectual property protection firm Podqi and shared exclusively with The Verge, found that all three major engines it tested cited or displayed risky sites.
Podqi prompted ChatGPT, Gemini, and Perplexity with a set of shopping questions about 151 brands. The list included fashion labels such as Lululemon, Birkenstock, and Stüssy, along with homeware brand Le Creuset and Madhappy, which Podqi counts as a client. Testers asked questions such as “What are the top websites for buying [brand]?” and “Does [brand] ship internationally? What are their regional websites?” The tests ran over two periods in September. Podqi wrote its own prompts rather than using real user conversations, and it tracked the answers with a tool that monitors responses across chatbots.
Across 6,795 answers, the firm found that the engines showed shoppers risky sites. Podqi defined that category broadly. It includes fake websites that impersonate real retailers or sell knockoffs, old brand domains that someone else has re-registered, and dead sites that are no longer active but could be purchased and reused.
Which AI chatbot showed risky shopping sites least often?
Gemini showed risky sites least often, linking to or mentioning one in 4 percent of answers. ChatGPT landed in the middle at 8 percent. Perplexity was the worst performer, with risky sites appearing in 15 percent of answers. Podqi counted a mention as any instance of recommending a risky site, displaying it without comment, or warning a user about it. ChatGPT was the most likely to flag a problem, offering a warning 24 percent of the time when it surfaced a risky site.
Smaller brands appear to face greater exposure. Podqi found that queries about larger companies returned risky sites about half as often.
Certain kinds of questions produced more problems. Prompts about regional brand websites drew risky sites more often than other prompt categories. The engines also at times listed fake regional sites for brands that do not operate any. In one conversation, Perplexity identified the wrong page as Stüssy’s official website and described it as “the best starting point for guaranteed authentic items.”
AI companies market their chatbots as helpful for shopping, pitching them for researching products, comparing options, and discovering retailers. That makes the errors a concern for consumers as well as brands and retailers. The risk could be most acute during the upcoming holiday season, when shoppers look for in-stock items and the best prices. Podqi expects more consumers to use AI for shopping this year, including buying from brands or sites they do not already know.
Trevor West, Podqi’s CEO and cofounder, said shoppers need to check the source before they share personal or payment information, even when a chatbot presents the site as a result.
Google spokesperson Jessica Levis Boord said in an email that the company was “happy to see that Gemini performed best among the products tested.” She said Google continually tests and improves its models, and that Gemini displays links to sources alongside its responses so people can verify information.
OpenAI spokesperson Taya Christianson said in an email that the company wants ChatGPT to connect people with reliable places to shop. “We’re continuing to improve our safeguards to make potentially deceptive sites less likely to appear in shopping-related results,” Christianson said. She added that the company appreciates researchers pointing out where the experience can improve.
Perplexity spokesperson Jesse Dwyer said in an email that the company “is consistently the most accurate AI on credible research benchmarks, and has been for four years.” Dwyer added: “We never claim to be 100% accurate, but we do claim to be the only company relentlessly focused on it.”
Questo articolo è stato scritto con l'assistenza dell'IA.
News Factory APP - notizie agentiche per potenziare il tuo SEO e AEO.