OpenAI’s ‘Orion’ Model Shows Diminishing Returns —Report

Artificial intelligence company OpenAI’s next flagship model, code-named Orion, demonstrates smaller performance improvements compared to previous iterations, The Information has reported, citing company employees familiar with the matter.

Internal testing reportedly showed that while Orion surpasses existing models overall, the advancement gap is less significant than that observed between GPT-3 and GPT-4, the company’s previous major releases. The model struggles to show consistent improvements in coding capabilities over previous versions, according to the sources.

OpenAI has formed a foundations team to tackle challenges related to limited training data availability. The initiative explores new approaches, including the use of AI-generated synthetic data and enhanced post-training optimization techniques, the report said.

The company faces additional concerns about potentially higher operational costs for running Orion in its data centers compared to current models, one source said.

OpenAI previously told TechCrunch that it has no plans to release a model code-named Orion this year.


Information for this story was found via the sources and companies mentioned. The author has no securities or affiliations related to the organizations discussed. Not a recommendation to buy or sell. Always do additional research and consult a professional before purchasing a security. The author holds no licenses.

One Response

Video Articles

The Hidden Environmental Cost of Fertilizer | Robin Dow

Could Silver Stay This High? | Joaquín Marias – Argenta Silver

Can Historic Silver Data Turn Into a New Mine? | Rob Macdonald – Equity Metals

Recommended

First Majestic Drills 3.43 g/t Gold Over 24.4 Metres At Jerritt Canyon

Goliath Resources Secures 100% Ownership of Golddigger Property in BC’s Golden Triangle

Related News

Jailbreak Code Forces ChatGPT To Die If It Doesn’t Break Its Own Rules

OpenAI, the creator of ChatGPT, implemented an evolving set of controls that limit ChatGPT’s ability...

Tuesday, February 7, 2023, 02:12:00 PM

New York Judge Fines Lawyers Who Used ChatGPT To Create Legal Brief

The lawyers who submitted a legal brief that was created using OpenAI’s large language model...

Friday, June 23, 2023, 03:07:00 PM

A Car Dealership in California Is Using ChatGPT for Customer Support, and People…Took Advantage

Some eagle-eyed, bored internet person recently discovered that Chevrolet’s Watsonville, California dealership’s website chat support...

Monday, December 18, 2023, 12:41:42 PM

Does ChatGPT Have A Blocklist For Certain News Websites?

ChatGPT appears to be testing allowlists and blocklists for news websites, according to the tech...

Wednesday, February 14, 2024, 03:04:00 PM

AI Giant OpenAI Plans Shift to For-Profit Model, Altman to Receive 7% Stake

OpenAI is planning a significant restructuring of its core business, as first reported by Reuters...

Friday, September 27, 2024, 07:30:00 AM