Frictional Game Wiki

<h1>Animation - Lipsync</h1> <div class="level1"> </div> <h3>Introduction</h3> <div class="level3"> <p> This tutorial was written for anybody working on animations that want a character to automatically lipsync. Lipsyncing is a technique used to move the mouth of a character to match the dialogue it is speaking. How the mouth should move is calculated in the code using the voice recording of the dialogue as well as a written transcript. This takes the line and converts it into phonemic characters. These are then converted into visemes which are used to move the mouth. The visemes has to be created by hand and that is what this tutorial will detail. </p> </div> <h3>Visemes</h3> <div class="level3"> <p> A viseme is a position that the mouth has when making a sound. We use a 3rd party imlementation from Annosoft. They have three different viseme mappings that can be used, each of different quality. The best quality comes from using 17 Visemes. </p> <p> These pages show which visemes are needed and how to model them. </p> <p> <a href="http://www.annosoft.com/docs/Visemes17.html" class="urlextern" title="http://www.annosoft.com/docs/Visemes17.html" rel="nofollow">http://www.annosoft.com/docs/Visemes17.html</a> </p> <p> <a href="http://www.annosoft.com/docs/Visemes17.html" class="urlextern" title="http://www.annosoft.com/docs/Visemes17.html" rel="nofollow">http://www.annosoft.com/docs/Visemes12.html</a> </p> <p> <a href="http://www.annosoft.com/docs/Visemes17.html" class="urlextern" title="http://www.annosoft.com/docs/Visemes17.html" rel="nofollow">http://www.annosoft.com/docs/Visemes9.html</a> </p> <p> The visemes should be saved in "entity/animations/visemes/" </p> <p> <b>Setting up</b> </p> <p> When the visemes are created they need to be setup in the ModelEditor. </p> <ul> <li class="level1"> Open the entitiy file in the ModelEditor</li> <li class="level2"> Click on Entity Settings > Animations</li> <li class="level2"> Add a new animation for each Viseme</li> <li class="level2"> Select the .dae_anim file for a Viseme</li> <li class="level2"> Name the animation after the number of visemes and the order of the annosoft website documentation. Using the naming convention Visemes_&lt;Quality>_&lt;ID></li> <li class="level2"> Ex) <a href="http://www.annosoft.com/docs/Visemes17.html" class="urlextern" title="http://www.annosoft.com/docs/Visemes17.html" rel="nofollow">http://www.annosoft.com/docs/Visemes17.html</a> Frame 1 (AA) should be named Visemes_17_1</li> <li class="level2"> When all of the visems has been setup the engine takes care of the rest</li> </ul> </div> <h3>Lipsync Tool</h3> <div class="level3"> <p> Can be used to edit the anno files. More to come… </p> </div>