By Nydia Han,Cheryl Mettendorf
Publication Date: 2026-10-09 21:20:00
As more shoppers turn to artificial intelligence tools to help find deals, a recent study urges consumers to verify product information and pricing, as some platforms appear to be more reliable than others.
About 40% of consumers are using AI for shopping, according to Product AI.
To evaluate the accuracy of popular AI platforms, Product AI tested ChatGPT, Gemini, Claude and Perplexity using hundreds of shopping-related questions.
According to Dakota Nunley of Product AI, the company asked the platforms 220 shopping questions on everything from pricing to comparisons of products across nine different product categories and recorded those results.
Their study found numerous errors across the platforms.
“Everything from MacBook pricing being off by $300 in some cases, to SPF sunscreen being off by 10 points, to earbud battery life being off by six hours,” Nunley said.
Despite the mistakes, the study found differences in performance among the platforms.
“But some tools are better than others?” asked Nydia Han.
“That’s what we saw,” Nunley responded.
Nunley noted that AI models are constantly changing and improving, meaning results from studies such as this one can vary over time.
Among the platforms tested, Product AI ranked Gemini last. Claude finished third, followed by ChatGPT in second place.
“Gemini, over half of the questions and shopping-related questions that we asked did have some sort of costly error for consumers,” Nunley said, adding that the finding applied “on both the…
