How AI Dubbing Keeps the Star's Own Voice in Every Language
A star gives your film one performance. Their voice, timing and feeling are all in that take. When the film is dubbed for a new market, a usual dub replaces that voice with someone else's. The audience sees a face they know and hears a stranger. With Lipsmatch, our technology recreates the star's own voice in the new language, and the mouth is matched to the new words. The star speaks every language themselves, and the performance travels with the film.
What a usual dub loses
People know a familiar voice within a few words, so they notice at once when it is missing. In a usual dub, a different person reads the translated lines over the original picture. On a famous face, the change is clear from the first line. The brand paid for the star, and in every dubbed market the audience hears someone else. The picture has a second problem. The lips still move for the original language, so the face and the sound disagree.
Aamir Khan shot the NutriChoice film once, in Hindi. For its Tamil and English versions, our technology recreated his own voice and matched his lips to every word, so the star the brand hired speaks Tamil and English himself.
What the star's own voice keeps
- The voice the audience knows. Our technology recreates the star's own voice in the new language. Its tone and character stay the same, so the voice still belongs to the face.
- The timing of the take. The new lines are fitted to the original edit. Pauses, jokes and emotional beats land where the face expects them. Then the mouth is matched to the new language, frame by frame, so the lips and the sound agree.
- The meaning of the lines. Translation is supervised, so the writing survives. Each line says what the original meant, in words that sound natural to the new market.
Bring your own dub, or let us make it
If you already have dubs for your markets, bring them, and we match the mouth to each one. If you have no dub in a language, we produce it for you. Our technology recreates the star's own voice, and translation is supervised. In the picture, only the mouth changes. Everything else in the frame stays as you made it. All voice and likeness work runs on the approvals you already hold.
The full process is in What is Lipsmatch. The four signs that give a dub away are in Why dubbed ads feel off. If you have a film that needs to reach new markets, tell us about it.