When you purchase through links on our site, we may earn an affiliate commission.Heres how it works.
It can even work on faces not directly looking into the camera.
This would, for example, allow a lone AI filmmaker to create an entire production with dialogue.
Kling is getting close to that but its no Danny DeVito.
How does lip sync in Kling work?
When you use lip sync in Kling you start by generating a video.
You then click match mouth and it will track the mouth movement throughout the video.
This takes up to about ten minutes but is what makes Kling so effective.
Once the mouth movements have been tracked and isolated you’ve got the option to upload some audio.
What else was launched?
Kling launched Motion Brush in the previous update.
This is similar to the motion brush feature in Runway Gen-2.
We are still waiting for this to return to Runway.
It basically lets you select elements in an image and tell Kling how to make them move.
The best example Ive seen of this was for a yoga video.
Overall Kling has firmly cemented itself as a leader in the generative AI video space.