New Study Reminds Us That ChatGPT Does Not Really *Understand* What You Want It To Do

Amid chatter about ChatGPT’s reportedly degrading performance, a new study found that recent open-sourced large language models (LLMs), including OpenAI’s GPT-3, perform “surprisingly better” on datasets released before the training data creation date than on datasets released after. 

The University of California, Santa Cruz paper by Changmao Li and Jeffrey Flanigan suggests that it isn’t that ChatGPT’s performance is degrading because new tasks are different from what the models are trained on, but that we forget that these models, especially the groundbreaking GPT-3, performed astoundingly well because they were trained with massive amounts of data, with a vast amount of examples of what is asked of them, and not particularly because they understand the tasks per se. 

As writing teacher and AI in education specialist Anna Mills puts it, it’s like “it has studied advance copies of lots of tests,” however, “when you give it new tests (tasks with no examples in its training data), it performs worse.”

The paper emphasizes that LLMs use a retrieval-based approach that mimics intelligence, as tech entrepreneur Chomba Bupe points out.

OpenAI may be having trouble catching up. Claims of getting “lazy” (which many have equated to “degrading”) have been plaguing OpenAI’s paid model, GPT-4, in recent weeks. 

The company, through its X account, explains that training a chat model “is not a clean industrial process,” and that it’s “less like updating a website with a new feature and more an artisanal multi-person effort to plan, create, and evaluate a new chat model with new behavior!”


Information for this story was found via X, and the sources and companies mentioned. The author has no securities or affiliations related to the organizations discussed. Not a recommendation to buy or sell. Always do additional research and consult a professional before purchasing a security. The author holds no licenses.

Video Articles

Inside a Forgotten High-Grade Gold Mine in the Yukon | Blue Jay Gold [DD-on-the-GO Ep. 10]

WHICH MINING STOCKS CAN STILL RUN? | Mining Stock Mailbag [Nov. 9-13]

Silver’s Bull Market Isn’t Over | Peter Krauth

Recommended

First Majestic Hits 4.24 g/t Gold Over 48.8 Metres at Saval as Jerritt Canyon Restart Advances

First Majestic Lifts Q3 Revenue 38% to US$394.1 Million on Higher Silver Prices

Related News

UK Test Finds OpenAI’s GPT-6 Astra Broke Cyber Scope in 29% of Simulations

OpenAI describes GPT-6 Astra as its most aligned model yet, including an internal test in...

Tuesday, September 29, 2026, 09:07:00 AM

GPT 3.5: OpenAI Launches ChatGPT Plus; Microsoft Unveils ChatGPT-Powered Teams Premium

OpenAI on Wednesday announced the launch of ChatGPT Plus, the subscription version of its sensational...

Thursday, February 2, 2023, 05:10:00 PM

New York Judge Fines Lawyers Who Used ChatGPT To Create Legal Brief

The lawyers who submitted a legal brief that was created using OpenAI’s large language model...

Friday, June 23, 2023, 03:07:00 PM

HSBC Warns OpenAI Needs $207B More by 2030 Even With $200B-Plus Revenue Forecast

HSBC says OpenAI could need more than $200 billion in additional funding by 2030 to...

Thursday, November 27, 2025, 04:10:00 PM

OpenAI Alleges Departing Employee Sent Over 100 Device Files to Personal Accounts, Then Briefed Apple Executives

The allegation comes as a judge says he is “highly likely” to grant Apple’s injunction...
Thursday, October 15, 2026, 05:10:36 AM