Video Dubbing - Personalizing speech in actual video at scale
1
Navigate to Step 2 of your campaign.
2
Click on "Video Dubbing" under the "Presenter" drop down.
3
Video Dubbing consists of 2 parts;
1. The audio aspect.
2. The visual aspect.
We'll discuss these in more detail later on in the tutorial.
4
Click on "Upload a pre-recorded video" to upload a video that you want to dub over.
5
A window will open which outlines the guidelines you must follow in order to achieve optimal results with Video Dubbing.
6
Upon uploading a video, your voice will be cloned for dubbing purposes and preserved for future use. For optimal voice cloning results, ensure that the duration of your speech in the video exceeds 25 seconds.
7
When speaking, it's essential to pause briefly after saying the word you intend to dub over or replace with a variable. For instance, if you wish to dub "Hi there! Nice to meet you." with "Hi John! Nice to meet you.", pause after saying the word "there".
8
To ensure optimal results for the visual aspect mentioned earlier, it's important to remain still and motionless while speaking the words you plan to replace later. For instance, if you say "Hey there!" and intend to replace the word "there" with another word or variable such as a first name, strive to minimize head movement to achieve the best outcome.
9
To achieve optimal video dubbing results, it's crucial to maintain a distance of 3 to 4 feet from the camera while recording the video. This distance ensures that mouth movements are accurately captured and seamlessly integrated with the replaced word or variable.
10
Utilizing a high-quality noise-cancelling microphone in a quiet environment guarantees that the recorded voice will be cloned to deliver exceptional results.
11
Click on the "Upload Video" button to select a video from your computer.
12
After selecting a video, the uploading process will commence, accompanied by a progress bar indicating the amount of video uploaded.
13
The audio-visual quality of your output directly depends on the quality of your input video. Higher-quality uploaded videos result in higher-quality output or generated videos. Please note that the current upload limit for a video is set to be under 50 Megabytes.
14
After the video has been uploaded, another window will prompt to confirm if you'd like to process it for use in your campaign. This processing involves extracting the audio for voice cloning and isolating the person in the video for lip-syncing. The window also reflects the amount of credits required for processing.
15
Click on the "Yes" button to process the uploaded video and continue.
16
Another window will prompt you to enter a name for the video, which will serve as a reference for you in the future. Choose a name that you'll easily remember, as it will also become the name of the cloned voice.
17
Click the "Continue" button once you've typed the name of the video and would like to proceed.
18
Another window will appear which shows the progress on the uploaded video being processed.
19
Click on the "Continue" button to proceed as the uploaded video is being processed.
20
The video has now been processed and is ready for use in your campaign.
21
You can click on the audio selector button to see and select the cloned voice.
22
Once you click on the voice selector, a window will open which allows you to select a voice.
23
Clicking on "Cloned Voices" will navigate you to display the cloned voices available for use in your account. These cloned voices can be from third party integration, as well as the videos you upload to Video Dubbing.
24
To listen to the cloned voice, you can click on the "Play" button.
25
Select the cloned voice you wish to employ. Remember, for Video Dubbing, each cloned voice is linked to the specific video it was uploaded with. You can't interchange cloned voices between different videos for dubbing purposes.
26
Click on the "Use selected Voice" button to use the selected cloned voice and continue.
27
Click on the "Enable speech modification" button to begin making changes to the script.
28
After clicking on the "Enable Speech Modification" button, a script box will appear containing the transcription of the audio from the uploaded video.
29
You can highlight the word you want to replace in the script. Once highlighted, you can either type another word,
30
or click on the "Insert Variable" button
31
and choose the variable you want to replace the highlighted word with.
32
Once the variable is chosen from the drop down menu, it will replace the highlighted word.
33
Click on the "Play Script" button to listen to what the audio of the generated video will sound like once the video is generated.
34
Once you click on the "Play Script" button, a window will open where it will ask you to insert a sample variable that you'd like to hear when the script is played.
35
Since we used a firstname variable to replace a word in the script for this tutorial, we can enter a name we'd like to hear.
36
Once the sample variable has been typed in for the given field, click on the "Continue" button to proceed and listen to what the audio will sound like with the replaced word.
37
Please wait as the system works on compiling the new variable with the script to present you with what the new audio will sound like in your generated video.
38
Once the script starts playing, you can see the duration of the script,
39
as well as the quality of the voice that was extracted from the uploaded video.
40
Click on the "Stop Script" button to halt the reading of the script.
41
Swipe down and click on the "Update" button to save the changes made to your video.
42
Click on the "Generate Video & Continue" button to generate a sample video and continue to the next step.
