YouTube is currently testing a new tool that will help creators automatically dub their videos into other languages using AI, the company announced Thursday at VidCon.
At VidCon 2023, YouTube has announced that it will allow creators to dub their videos into other languages using AI. The software, developed by Aloud and part of Google’s Area 120 incubator, will open content to a much wider audience when implemented.
Previously, creators had to partner directly with third-party dubbing providers to create their audio tracks, which turns out to be a long and expensive process. Aloud allows them to dub videos at no additional cost, but it’s unclear whether or not Google will monetize the service in the future. YouTube also allows users to use automatic captions if the author of the video did not provide captions, but did not previously offer voice dubbing.
Also Read – YouTube might finally be resurrecting this super-popular sorting feature
How will dubbing on YouTube work?
According to Aloud’s website, the tool transcribes your video and gives you a transcript that you can review and edit. The good news is that the AI is not only responsible for translating the script, but also for producing the dubbing. According to YouTube’s Amjad Hanif, the platform is already testing this tool with hundreds of content creators.
He clarified that Aloud currently supports a few languages and more will follow in the future. For now, the tool is available in English, Spanish and Portuguese, said Jessica Gibby, spokeswoman for Aloud.
Thanks to Aloud, a growing number of creators could add multilingual dubs to their video, and therefore open up to a whole new audience. Aloud is not yet available to all users, but there is a waiting list that users can join if they want access.
Hanif added that YouTube “ strives to make translated audio tracks sound like the creator’s voice, with more expression and lip-syncing “. Generative AI should also allow Aloud to launch features such as voice preservation, better emotion transfer, and lip “reanimation”.
