Changes this week

VideoBy Serchai · Published on · 4 steps

How to dub a video into another language with AI, no reshoot

Guide to AI video dubbing: lip sync and cloned voice with HeyGen, voice-only alternative with ElevenLabs and quality control before publishing.

ToolsHeyGen · ElevenLabs · Descript
Stack costFrom $45/mo
Updated

00Tools you will use

Stack: Descript $16 + dubbing from $5
Card 01/03 · TranscriptFREE + $16

Descript

3.9Fair

Edit video and audio by deleting words from the transcript, like in a document.

PriceFree + from $16
JobThe clean text base the script gets translated from.
Read the review ↗
Card 02/03 · DubbingFREE + $24

HeyGen

3.6Fair

AI avatar video and dubbing with lip sync in over 100 languages.

PriceFree + from $24
JobCloned voice and lip sync when there is a face on screen.
Read the review ↗
Card 03/03 · VoiceoverFREE + $5

ElevenLabs

4.4Very good

Near-human synthetic voices for narration and dubbing.

PriceFree + from $5
JobThe new voice when the video shows nobody speaking.
Read the review ↗

TLDR: Dubbing a video no longer requires reshooting or hiring a voice actor per language. HeyGen translates while keeping your cloned voice and matching lips to the new audio, ElevenLabs covers cases where you only need the voice, and Descript gives you the clean transcript to start from. The technology delivers. What decides the result is the script translation and a native review before publishing.

his guide is for anyone with content that works in one language and a potential market in another: corporate training, product video, creator channels, internal comms in distributed companies. The good material is already recorded, and re-recording it per language is what made going international expensive.

Important warning upfront: cloning a person’s voice or likeness requires their explicit permission. This guide assumes you are dubbing your own content or have written authorization from whoever appears.

1. Choose which videos deserve dubbing

Dubbing the whole catalog is the expensive mistake here. The translated version inherits the original’s performance: a video nobody watches in English will not be watched in German either. Sensible selection looks at two things.

First, permanence: prioritize evergreen material (explanations, training, product demos) over what expires in weeks. Dubbing cost amortizes over the time the piece stays alive. Second, proven performance: dub what already works, not what you hope will.

And the market question that avoids wasted work: will you serve that language? Publishing video in Italian and not answering Italian comments projects abandonment, not expansion.

2. Prepare and translate the script with judgment

Automatic dubbing starts from the transcript, so the transcript rules. Descript gives you that clean base: it transcribes the video and lets you fix proper nouns, spoken numbers and jargon on the text, which is exactly where automatic recognition fails. It has a free plan with 60 minutes a month and paid from $16.

With correct text, translation needs human judgment at three points: proper and brand names (which should not be translated), numbers and units (whose format changes by country) and local expressions or wordplay (which need an equivalent, not a literal translation).

This step determines more than any other whether the result reads as international or as a shortcut.

Dubbing technology is solved. Unreviewed translation is what exposes it.

Where a dub actually falls apart

3. Dub with lip sync in HeyGen

HeyGen does the visible work: it translates video into over a hundred languages, and its free plan gives three videos a month to evaluate it. If the video shows nobody speaking, lip sync is surplus and ElevenLabs does better and cheaper. The division rule is the shot itself:

By the shotThere is a talking faceHeyGen keeps your cloned voice and adjusts lip movement to the new audio. The result is not a voice-over, it is the same person speaking another language.From $24/mo
By the shotThere is only voiceScreen captures, footage or slides: lip sync has nothing to do, and ElevenLabs generates the voiceover with fine control over pace, pauses and emphasis.From $5/mo

Quality is not equal across languages: major ones perform better. Test yours on the free plan before committing budget.

4. Run quality control before publishing

Quality control on a dub has one valid standard: someone who speaks the language natively reviews the whole thing. Not a read of the script, the complete piece, because problems appear in the interaction between text and pacing, not on paper.

What that reviewer looks for fits in a short list, and anything they find gets fixed by regenerating only the affected fragment, not the whole piece.

Quality control · before publishingNative review, complete piece
Proper nouns and brands left untranslatedScriptFixed before generating
Numbers and units in the local formatScriptFixed before generating
Local expressions replaced, not translatedNative reviewerJudged by ear
Audio and mouth with no driftNative reviewerFragment regenerated
Captions and burned-in on-screen textEditRedone separately

Problems appear in the interaction between text and pacing, not on paper.

Once the pipeline is built, the marginal cost of each new language is low, and that is the real change: deciding which markets to enter stops being a budget question and becomes a strategic one. To take dubbed content to social, the clips from long video guide closes the loop, and multilingual subtitles have their own guide. The whole sector lives in AI for content and media.

Common mistakes

Dubbing without native review. The technology sounds good and that is what deceives: the error sits in the text, and someone who does not speak the language will not catch it until a customer does.

Cloning other people’s voices without permission. Beyond the legal problem, this is the use destroying trust in these tools. Your voice only, or explicit written permission.

Dubbing the entire catalog at once. Start with three pieces, measure whether the market responds and scale on data. The opposite is prepaying for an audience that may never appear.

Forgetting on-screen text. The audio ends up in Italian while the captions stay in English. If the video carries burned-in text, it has to be redone too or the piece looks half finished.

Frequently asked questions

How much does dubbing a video cost?

HeyGen’s free plan lets you dub three videos a month to evaluate. Paying, from $24 a month, and if you only need voice without lip sync, ElevenLabs from $5 covers it.

Can people tell the dubbing is automatic?

The technical side, barely: cloned voice and lip sync have reached a level that holds up. What always shows is unreviewed translation, especially on proper nouns and local expressions.

Can I dub a video with several people speaking?

Yes, though the result improves the cleaner the voice separation is. If the original recording has separate tracks per participant, the dub comes out considerably better than from a single mix.

Only with their explicit permission. Cloning someone’s voice without authorization carries legal consequences in most jurisdictions and is also the practice costing these tools their reputation.

The steps, in short

  1. Choose which videos deserve dubbing

    Prioritize evergreen, high-performing material instead of dubbing the whole catalog.

  2. Prepare and translate the script with judgment

    Start from a proofed transcript and adapt names, numbers and expressions before generating anything.

  3. Dub with lip sync in HeyGen

    Generate the new-language version keeping your cloned voice and matching lip movement.

  4. Run quality control before publishing

    Have a native speaker review the whole piece and fix what sounds off by regenerating only that part.

Video

Related guides

Which tool will you pick? See the full video ranking.

See the category ranking
What do you want to do?
Assisted decision · ES/ENRequirements · price · limitations · dated sources

What do you want to do?

Tell us in the same words you would use with another person.

We keep a sanitised query for 90 days to improve the engine. Privacy.