Lip Sync



Creating Facial Expressions Synced to Dialogue
Creating speech may appear to be a difficult endeavor, but on inspection it's not as formidable as one might think. English speech can be generalized into seven basic mouth expressions as shown below.


Starting from the neutral expression:



To form the remaining dialogue expressions:

Step 1 - Recording The Dialogue And Creating The Sound Diagram

Planning a dialogue begins with recording the sound and then placing the words underneath the audio tracks for use in determining the mouth position to be used and the keyframe it is to be assigned to.

Illustration 1 - Creating the sound diagram

Step 2 - Creating A Model Of The Head

The next stage is the creation a model of the head to be used in forming the various expressions that correspond to the seven basic mouth positions shown above. Refer to the Face Sculpt example for a detailed description of how to model the human face.

Illustration 2 - Opening the Modeler Morph Dialog

Step 3 - Creating The Facial Expressions

The next step involves reshaping the model of the head to create the seven expressions defined above.

Illustration 3 - Moving vertices to create a facial expression

Step 4 - Setting the Lip Sync Animation Timing

With the information gathered from the timing diagram, and with the seven dialogue expressions defined in the Modeler module, it's time to proceed to the Presenter module and set up the animation.


Illustration 4 - Setting time at frame = 0

Illustration 5 - Assigning the KineMagics Morph plug-in


Illustration 6 - Setting facial expressions to match a dialogue.



Illustration 7 - The Presenter Control Room set up for previewing the sound and animation.