OpenAI’s ‘Orion’ Model Shows Diminishing Returns —Report

Artificial intelligence company OpenAI’s next flagship model, code-named Orion, demonstrates smaller performance improvements compared to previous iterations, The Information has reported, citing company employees familiar with the matter.

Internal testing reportedly showed that while Orion surpasses existing models overall, the advancement gap is less significant than that observed between GPT-3 and GPT-4, the company’s previous major releases. The model struggles to show consistent improvements in coding capabilities over previous versions, according to the sources.

OpenAI has formed a foundations team to tackle challenges related to limited training data availability. The initiative explores new approaches, including the use of AI-generated synthetic data and enhanced post-training optimization techniques, the report said.

The company faces additional concerns about potentially higher operational costs for running Orion in its data centers compared to current models, one source said.

OpenAI previously told TechCrunch that it has no plans to release a model code-named Orion this year.


Information for this story was found via the sources and companies mentioned. The author has no securities or affiliations related to the organizations discussed. Not a recommendation to buy or sell. Always do additional research and consult a professional before purchasing a security. The author holds no licenses.

One Response

Video Articles

Silver Is in a New Price Regime, and the Market Isn’t Used to It | Keith Neumeyer – First Majestic

Agnico Eagle Just Made a Massive Gold Land Grab

A Copper-Gold Deposit Caught the White House’s Attention | Rob McLeod – Cambria Gold

Recommended

Antimony Resources Drills 4.38% Sb Over 7.05 Metres At Bald Hill In Final Hole Of 2025 Program

Kirkland Lake Drills 121 Metres Of 1.01 g/t Gold At Mirado

Related News

Microsoft Confirms Multibillion Investment Into OpenAI

Microsoft Corp (NASDAQ: MSFT) has announced that it is making a significant multi-year investment in...

Monday, January 23, 2023, 03:07:00 PM

OpenAI Board Found Out About the Launch of ChatGPT on Twitter

Former OpenAI board member Helen Toner revealed that the board was not informed about the...

Friday, May 31, 2024, 08:03:44 AM

Microsoft Made Preparations to Absorb OpenAI’s Departing Staff — Except They Didn’t Leave

Microsoft (Nasdaq: MSFT) was getting ready to receive OpenAI employees who wanted to follow CEO...

Monday, November 27, 2023, 07:37:22 AM

New Study Reminds Us That ChatGPT Does Not Really *Understand* What You Want It To Do

Amid chatter about ChatGPT’s reportedly degrading performance, a new study found that recent open-sourced large...

Thursday, January 4, 2024, 06:43:00 AM

Sam Altman Is Already In Discussions To Return To OpenAI

He may be down, but its not quite certain if he’s actually out. The Verge...

Sunday, November 19, 2023, 07:25:00 AM