A Car Dealership in California Is Using ChatGPT for Customer Support, and People…Took Advantage

Some eagle-eyed, bored internet person recently discovered that Chevrolet’s Watsonville, California dealership’s website chat support is running on ChatGPT and that it could respond to non-Chevrolet Watsonville-related questions. Of course, other bored internet people had to give it a run.

Threads user @documentingmeta posted the discovery as a workaround to save $20/month and access ChatGPT+ for free, as demonstrated by this prompt requesting a Python script.

Via Threads

It didn’t take long before people were using it to sell other cars for sh*ts and giggles. 

Via Threads
Via Threads
Via Reddit

The chatbot was reined in soon after, and users found it saying it could only respond to questions about automotive sales and services.

Via Threads

Soon after, another user found that one could also do the same thing with the chatbot for Infiniti, Nissan’s luxury division.

Via Threads

UPDATE: General Motors meanwhile reached out to us to provide the following statement, “The recent advancements in generative AI are creating incredible opportunities to rethink business processes at GM, our dealer networks and beyond. We certainly appreciate how chatbots can offer answers that create interest when given a variety of prompts, but it’s also a good reminder of the importance of human intelligence and analysis with AI-generated content.

The incident shows that (playing around with chatbots is only really funny at the start, but really that) OpenAI’s large language model may not be ready yet for customer service. Real customers would likely still want to chat with a human. 

SAAS company Zendesk, for example, wrote in October that while ChatGPT is “an impressive conversational AI chatbot,” they don’t recommend that it be used for customer support as it’s not built to be a customer service tool — “at least not yet.” 

Zendesk underscores the quirks that make using ChatGPT for customer service a bad idea for now, including its tendency to “hallucinate” or to make things up and present them as facts, make logic and reasoning errors, its inability to answer highly specific or niche questions, the security risks that may arise when it’s given customer information, and how it can give “biased or discriminatory responses that may harm your brand’s reputation.” 

Plus, it can also end up selling your competitors instead.


Information for this story was found via Threads, Reddit, and the sources and companies mentioned. The author has no securities or affiliations related to the organizations discussed. Not a recommendation to buy or sell. Always do additional research and consult a professional before purchasing a security. The author holds no licenses.

Leave a Reply

Video Articles

We’re At The Start of a Great Silver Boom | Ross McElroy & Andy Bowering – Apollo Silver Corp

Equinox Gold Q1 Earnings: When Everything Goes Wrong

SSR Mining Q1 Earnings: Costs Continue To Climb

Recommended

PTX Metals Hits 235.1 Metres Of Copper, Nickel Mineralization In Longest Intercept To Date At W2

Riverside Resources Spins Out Blue Jay Gold Corp

Related News

Stanford Student Finds That Academics Are Abusing ChatGPT

Software developer and student at Stanford University Andrew Gao has spotted something peculiar about recently...

Tuesday, August 15, 2023, 08:15:00 AM

Coming Soon: AI That Can Self-Replicate

If reading news about artificial intelligence makes you feel like humanity is inching closer and...

Wednesday, January 17, 2024, 04:51:00 PM

Telus, Nvidia To Partner For “Sovereign AI Factory” In Quebec

Telus and Nvidia have announced a landmark partnership to establish a so-called “sovereign AI factory”...

Wednesday, March 19, 2025, 10:40:00 AM

Google Considers Nuclear Power for AI Data Centers

Google (Nasdaq: GOOG) CEO Sundar Pichai has hinted at the possibility of using nuclear energy...

Sunday, October 6, 2024, 07:39:00 AM

OpenAI Announces New ChatGPT Version for Businesses

OpenAI has unveiled its newest offering since the debut of ChatGPT— an enterprise version of...

Tuesday, August 29, 2023, 06:23:00 AM