Saturday, August 23, 2025

New Study Reminds Us That ChatGPT Does Not Really *Understand* What You Want It To Do

Amid chatter about ChatGPT’s reportedly degrading performance, a new study found that recent open-sourced large language models (LLMs), including OpenAI’s GPT-3, perform “surprisingly better” on datasets released before the training data creation date than on datasets released after. 

The University of California, Santa Cruz paper by Changmao Li and Jeffrey Flanigan suggests that it isn’t that ChatGPT’s performance is degrading because new tasks are different from what the models are trained on, but that we forget that these models, especially the groundbreaking GPT-3, performed astoundingly well because they were trained with massive amounts of data, with a vast amount of examples of what is asked of them, and not particularly because they understand the tasks per se. 

As writing teacher and AI in education specialist Anna Mills puts it, it’s like “it has studied advance copies of lots of tests,” however, “when you give it new tests (tasks with no examples in its training data), it performs worse.”

The paper emphasizes that LLMs use a retrieval-based approach that mimics intelligence, as tech entrepreneur Chomba Bupe points out.

OpenAI may be having trouble catching up. Claims of getting “lazy” (which many have equated to “degrading”) have been plaguing OpenAI’s paid model, GPT-4, in recent weeks. 

The company, through its X account, explains that training a chat model “is not a clean industrial process,” and that it’s “less like updating a website with a new feature and more an artisanal multi-person effort to plan, create, and evaluate a new chat model with new behavior!”


Information for this story was found via X, and the sources and companies mentioned. The author has no securities or affiliations related to the organizations discussed. Not a recommendation to buy or sell. Always do additional research and consult a professional before purchasing a security. The author holds no licenses.

Video Articles

A Medical Breakthrough the Market Overlooked | David Elsley – Cardiol Therapeutics

Why Grade Beats Size in Silver Mining | Frank Basa – Nord Precious Metals

Are Investors Missing the Start of the Next Commodity Supercycle? | Morgan Lekstrom – NexMetals

Recommended

Emerita Resources Expands El Cura Drill Program By 10,000 Metres As Deposit Remains Open For Expansion

ESGold Signs MOU For Tailings Project In Colombia With Grades Up To 42 g/t Gold, 280 g/t Silver

Related News

ChatGPT Creator Launches Tool That Can — But May Not — Detect AI-Written Text

OpenAI, the company behind the internet-breaking “human-like” language model ChatGPT, on Tuesday released a new...

Wednesday, February 1, 2023, 04:37:00 PM

Elon Musk Unveils xAI, His Answer to the ChatGPT AI Revolution

Tesla (NASDAQ: TSLA) CEO and Twitter owner Elon Musk is aiming to challenge major tech...

Wednesday, July 12, 2023, 02:52:12 PM

OpenAI Announces ‘New Initial Board’ of Directors

The high-speed saga at OpenAI may not be over yet.  Bloomberg News, citing sources close...

Wednesday, November 22, 2023, 09:12:15 AM

OpenAI’s TPU Switch Exposes the Soft Underbelly of Nvidia’s AI Boom

Nvidia (NASDAQ: NVDA) warned in its latest Form 10-K that three direct customers individually generated...

Monday, June 30, 2025, 12:49:00 PM

OpenAI Launches ChatGPT Agent, AI System That Can Control Computers

OpenAI on Thursday launched ChatGPT Agent, an AI system that can autonomously control computers, browse...

Saturday, July 19, 2025, 11:17:00 AM