YouTube Expands Access to Improved AI-Powered Dubbing
December 12, 2024
Hundreds of thousands more YouTube channels are gaining access to its AI-powered auto-dubbing feature, which generates audio translation tracks for YouTube videos, helping to make the platform’s content more accessible to viewers around the world. The expanded rollout targets informational channels in the Partner Program, such as tutorials on cooking, sewing, tourism and home improvement. Availability “will expand to other types of content soon,” according to video streamer, which began testing the feature with select creators last year. Based on technology developed by Aloud, YouTube’s auto-dubbing emerged from the Area 120 internal incubator program.
“Videos dubbed using this feature will appear with an auto-dubbed label” but “viewers can choose to listen to the original audio by using the track selector,” reports Gadgets 360. “To use this feature, no special steps are required. Creators simply need to upload videos and YouTube will automatically detect its language and dub it in other supported languages.”
For those who don’t want the translations, “YouTube also provides options to unpublish or delete dubs,” The Verge writes, citing a YouTube Support page that offers additional details.
The feature is still not yet perfected, YouTube warns. “We’re working hard to make it as accurate as possible, but there might be times when the translation isn’t quite right, or the dubbed voice doesn’t accurately represent the original speaker,” YouTube explains in a blog post.
An episode of YouTube’s “Creator Insider” series provides a video tutorial on using the feature.
The company also has an update in the works “called ‘Expressive Speech,’ which is designed to help replicate the creator’s tone, emotions, and even the ambiance of their surroundings,” TechCrunch reports.
As with all things AI, voice translation is a rapidly advancing field. In November a company called BodyTalk debuted an app with facial moves to match, and another firm, Germany’s DeepL, claims to be able to translate to 33 languages in real time.
ElevenLabs is a leader in the AI audio and voice fields, including offering translation software. And like YouTube, Captions’ Lipdub app offers translations for free.
No Comments Yet
You can be the first to comment!
Leave a comment
You must be logged in to post a comment.