Thursday, September 4, 2025

Latest

A Car Dealership in California Is Using ChatGPT for Customer Support, and People…Took Advantage

Some eagle-eyed, bored internet person recently discovered that Chevrolet’s Watsonville, California dealership’s website chat support is running on ChatGPT and that it could respond to non-Chevrolet Watsonville-related questions. Of course, other bored internet people had to give it a run.

Threads user @documentingmeta posted the discovery as a workaround to save $20/month and access ChatGPT+ for free, as demonstrated by this prompt requesting a Python script.

Via Threads

It didn’t take long before people were using it to sell other cars for sh*ts and giggles. 

Via Threads
Via Threads
Via Reddit

The chatbot was reined in soon after, and users found it saying it could only respond to questions about automotive sales and services.

Via Threads

Soon after, another user found that one could also do the same thing with the chatbot for Infiniti, Nissan’s luxury division.

Via Threads

UPDATE: General Motors meanwhile reached out to us to provide the following statement, “The recent advancements in generative AI are creating incredible opportunities to rethink business processes at GM, our dealer networks and beyond. We certainly appreciate how chatbots can offer answers that create interest when given a variety of prompts, but it’s also a good reminder of the importance of human intelligence and analysis with AI-generated content.

The incident shows that (playing around with chatbots is only really funny at the start, but really that) OpenAI’s large language model may not be ready yet for customer service. Real customers would likely still want to chat with a human. 

SAAS company Zendesk, for example, wrote in October that while ChatGPT is “an impressive conversational AI chatbot,” they don’t recommend that it be used for customer support as it’s not built to be a customer service tool — “at least not yet.” 

Zendesk underscores the quirks that make using ChatGPT for customer service a bad idea for now, including its tendency to “hallucinate” or to make things up and present them as facts, make logic and reasoning errors, its inability to answer highly specific or niche questions, the security risks that may arise when it’s given customer information, and how it can give “biased or discriminatory responses that may harm your brand’s reputation.” 

Plus, it can also end up selling your competitors instead.


Information for this story was found via Threads, Reddit, and the sources and companies mentioned. The author has no securities or affiliations related to the organizations discussed. Not a recommendation to buy or sell. Always do additional research and consult a professional before purchasing a security. The author holds no licenses.

Video Articles

Goliath Resources Hits 10.60 g/t Gold Over 22.82 Metres, Highest Grade Results In Third Distinct Rock Package At Surebet Discovery

Four Countries Control the Fertilizer That Feeds the World | Sage Potash

$10,000 Gold Is Just A Question of Time | Florian Grummes

Recommended

Cormark Lifts Northern Superior Target To $2.00 On Drilling Success

Afghanistan Quake Deaths Pass 1,400

Related News

Apple Blocks ChatGPT-Powered App Over Content Filtering Concerns

Apple Inc. (Nasdaq: AAPL) blocked an update that adds a feature with a customized version...

Friday, March 3, 2023, 07:39:50 AM

Amazon Launches Bedrock, the New Rival to ChatGPT

Amazon is reportedly working on a new AI project known as “Bedrock” to compete with...

Thursday, April 13, 2023, 01:44:19 PM

Does ChatGPT Have A Blocklist For Certain News Websites?

ChatGPT appears to be testing allowlists and blocklists for news websites, according to the tech...

Wednesday, February 14, 2024, 03:04:00 PM

Did DeepSeek Steal Data from OpenAI?

Microsoft (Nasdaq: MSFT) and OpenAI are investigating suspected unauthorized harvesting of artificial intelligence data by...

Wednesday, January 29, 2025, 12:58:00 PM

Sam Altman Claims Ignorance on Equity Clawbacks But Data Says Otherwise

OpenAI CEO Sam Altman faced backlash over the company’s restrictive exit policies that threatened to...

Sunday, May 26, 2024, 09:10:00 AM