This New Video-Based AI-Powered Tool Lets You ‘Speak’ In Another Language

HeyGen, a generative AI video program, has unveiled a new feature that allows users to seamlessly translate their spoken content into different languages while maintaining perfect lip synchronization.

Traditionally, video translation involved the use of subtitles or dubbing, but HeyGen’s new technology aims to eliminate the need for these approaches. 

Users can now record a video in their native language, and HeyGen’s AI takes care of overdubbing the content in a language of their choice, with what it touts is “native-like fluency.” The program also superimposes realistic mouth movements on the video, creating a convincing illusion of the speaker using the chosen language. 

Selkirk Copper Mines — sponsored Sponsored · Selkirk Copper Mines

Currently, HeyGen supports translation into several languages, including English, Spanish, French, Italian, German, Polish, Portuguese, and Hindi.

The company, which was originally called Movio before a rebranding in April, also recently launched a way to create a “personal deepfake” or an AI-generated video double that can say practically anything you type into a text field. Its founder, Joshua Xu, says this new product is “more than just a translation feature; it’s a new paradigm for content consumption.”

To experience it for yourself, you’ll need to record a video of at least 30 seconds up to a maximum of 5 minutes, in mp4, Quicktime, or Webm format, with a file size not exceeding 500 MB and upload it here.

X user Jon Finger posted a test on Monday and the results, while still not completely natural-looking, were pretty astonishing.

In a reply, a native French speaker pointed out that the language Finger “spoke” was “technically perfect” but the accent was more French-Canadian or Québécois.

The potential impact of this technology extends to various industries, including content creation and localization. As HeyGen continues to refine its system, it could reshape the landscape of video translation and potentially impact industries like dubbing. And also, more deepfakes.


Information for this story was found via HeyGen, Jon Finger on X, and the sources and companies mentioned. The author has no securities or affiliations related to the organizations discussed. Not a recommendation to buy or sell. Always do additional research and consult a professional before purchasing a security. The author holds no licenses.

Video Articles

Inside a Forgotten High-Grade Gold Mine in the Yukon | Blue Jay Gold [DD-on-the-GO Ep. 10]

WHICH MINING STOCKS CAN STILL RUN? | Mining Stock Mailbag [Nov. 9-13]

Silver’s Bull Market Isn’t Over | Peter Krauth

Recommended

First Phosphate Adds UK Export Finance to Growing Export Credit Lineup With C$220 Million Letter of Interest

Epic Gold Outlines 150,700 Indicated Ounces at 2.26 G/T in Updated Benoist Resource

Related News

Oracle Cuts Cloud Jobs in US, India, and Canada Operations

Oracle Corp. (NYSE: ORCL) is laying off employees across its cloud infrastructure division this week,...

Thursday, August 14, 2025, 08:10:55 AM

Love ChatGPT? Buy Tesla Says Cathie Wood – Sees Stock Climbing To $1,500 In The Next 5 Years

Ark Invest chief Cathie Wood is putting a lot more faith in Tesla (Nasdaq: TSLA)...

Monday, February 13, 2023, 02:22:00 PM

Scammers Use AI to Clone Girl’s Voice in $1 Million Kidnapping Scheme

The acceleration of artificial intelligence has made tools more accessible to anyone, including scammers always...

Thursday, April 20, 2023, 04:01:00 PM

Japan’s Government Foregoes Copyright Enforcement on Data Used for AI Training

The Japanese government recently asserted that it would not require copyrights on data used in...

Saturday, June 3, 2023, 07:15:00 AM

Don’t F*ck With Swifties: Fans Track Down Canadian Man Who Posted AI-Generated Taylor Swift Pics On X

As AI-generated photos of Taylor Swift, currently one of the most influential celebrities in the...

Monday, January 29, 2024, 01:04:00 PM