Frictional Game Wiki

<h2>Sound</h2> <div class="level2"> </div> <h3>FMOD</h3> <div class="level3"> <p> HPL3 uses FMOD to handle all sound playback. See <a href="http://fmod.org" class="urlextern" title="http://fmod.org" rel="nofollow">fmod.org</a> for more details, documentation and help. When working with sounds it is mainly the <a href="http://fmod.org/fmod-downloads.html" class="urlextern" title="http://fmod.org/fmod-downloads.html" rel="nofollow">FMOD Designer tool</a> that will be of interest, the easiest way to learn how it works is to check the tutorials in <a href="http://www.youtube.com/user/FMODTV" class="urlextern" title="http://www.youtube.com/user/FMODTV" rel="nofollow">FMOD's YouTube channel</a>. </p> </div> <h4>General</h4> <div class="level4"> <p> It is important to plan and think through how to split up your sounds into different projects. The game will load sounds based on this, it will help you find your sounds, it will ease preloading if you need to use that and so on. </p> </div> <h5>Project</h5> <div class="level5"> <p> Create a project for large chunks of sound types, for example a project for each character, level or for physics. Each project can contain many groups of sound events, preferably a hierarchy of 1-2 sub-groups will make it organized and easy to work with when for example optimizing (see script functions for preloading a project or a specific group!). More details about this is found under FMOD Designer Events. Some type of sounds need to follow a special structure and naming convention! See the sections below, for example physics and footsteps. </p> </div> <h5>Banks</h5> <div class="level5"> <p> A bank stores all the sounds for a project, you can have many banks but you should normally only need two. One bank for sounds that you load into memory to play and one bank that streams sounds from the harddrive and plays them. Special cases where you need to have more banks would be if you have sounds that are localized to different languages, where you have one bank for each language. </p> <p> Sounds to be streamed are usually longer sounds, such as a looping ambient track or voices. Be cautious with using streamed sounds, streams depend on the speed of the harddrive, so what works well for you might not be so for another user. Try to keep the number of simultaneous streams to something low, perhaps max 6 streams. Remember that music and dialog streams, so could easily be 3 streams if you have a cross-fade of music going when a voice is played. </p> </div> <h4>FMOD Designer Sound Defs</h4> <div class="level4"> <p> A sound def is the settings for a sound (or set of sounds for variation) that you can use in your Multi-track events. There is nothing specific to keep in mind for these, do as suitable and follow the FMOD documentation. </p> </div> <h4>FMOD Designer Events</h4> <div class="level4"> <p> The Events are what you actually use when playing sounds in the engine. The events are what replaces our old system of playing a SNT file, which essentially worked in the same way as Simple Events. When working with events there are a few things to keep in mind, mainly to organize events into easy to navigate groups and to use categories to send the events to be processed (or not processed) by the proper global effects. </p> </div> <h5>Simple Event</h5> <div class="level5"> <p> Nothing in particular to keep in mind beyond the basic usage as specified by the FMOD documentation. Just check our general important notes for events and performance concerns for info on why you should use simple events and any minor specific setting you might need to set. </p> </div> <h5>Multi-track Event</h5> <div class="level5"> <p> These events allow for parameters to affect the sound in a detailed manner, for example changing the sound of an impact depending on the speed of the object or much more advanced mixes. Make sure to view Performance concerns for Events to not overdo it. These events replace what previously was set with a lot of parameters in the snt editor, model editor and level editor for sounds. The move to FMOD makes it possible for a sound designer to do much more without any engine specific knowledge or assistance from a programer/scripter. </p> <p> A quick overview of events, for details check FMOD documentation and tutorials. </p> <p> An event is created with layers, a layer can contain one or many Sound Defs. At first glance it is much like any sound editor, but as you begin to make your first event you notice that what normally is a representation of time is not so in the context of making FMOD Events. </p> <p> To be able to move your sounds around you will need to right-click the top of the event and add a parameter. The parameter can represent numerous things, such as time or the engine sending in a value with the speed of an object. These parameters can be used to make envelope mixes and different sound def play depending on the value of a parameter or mix of parameters. For example see physics, the engine sends in the speed and mass of an object, the speed sets the volume and what type of sound def to play and the mass is used to change the pitch of the sounds (increase mass = lowered pitched sound). </p> <p> Let's say we have a machine in the game and the player will be able to start and stop this machine. A single event can be created to be used for this, where we first play a sound as the machine starts up, then loops a sound while it is running and finally plays a sound as it stops. </p> <ol> <li class="level1"> Right-click and add a parameter to the event, the name does not matter.</li> <li class="level1"> Right-click the parameter and choose parameter properties, set Velocity to 1. This will make the event play like in a typical sound editor.</li> <li class="level1"> Right click on your layer and add in three sounds defs. This should be a start sound, a loop sound and a stop sound. </li> <li class="level1"> Right-click on the start and stop sound defs and choose Sound instance properties… Set Loop mode to oneshot.</li> <li class="level1"> Play the event, make sure it plays the start, loop and then stop sounds in correct order as you like. If you like, drag the sound defs a bit over each other and they will automatically cross-fade.</li> <li class="level1"> To test envelopes, right-click the section to the left (where it says layer0) and Add effect. Choose Volume.</li> <li class="level1"> Right-click on the red envelope line to add points that you can use to fade the sound. Play the sound and notice that it fades the sound after the envelope, just like in a sound editor.</li> <li class="level1"> Right-click the "timeline" and add a sustain point somewhere in the looping sound. Play the sound and notice that it stays and loops the looping sound at the sustain point.</li> <li class="level1"> Press the key off button and notice how the event move along and plays the stop sound and then ends.</li> </ol> <p> From this simple example you can see (hear) the possibilities that are available to you as the sound designer to create interesting and easy to use sound events. This event would allow the person scripting to simply play the sound as the player starts the machine, and then as the player stops the machine the script would stop the sound (which triggers key off) and the sound stops with playing the stop sound as you designed it. </p> </div> <h5>Important notes for Events</h5> <div class="level5"> <ul> <li class="level1"> Make sure that all events that should be looped are set to "Oneshot" <b>false</b>. If not, there might be all sort of strangeness in the sound playback.</li> <li class="level1"> Use unique names for all projects, as the .fev file it creates with the same name, must be unique for it to work correctly.</li> <li class="level1"> For looping (non "Oneshot") sounds that are to be in the environment, like fire from a torch, always use "just fail if quietest" max playback behavior. This will make sure that if there are many sounds of the same type around the player, it will be the loudest once that are heard. Other options are possible, but using any of the "steal" ones are almost always a bad choice.</li> <li class="level1"> Must use Gui or World category, see categories section.</li> </ul> </div> <h5>Performance concerns for Events</h5> <div class="level5"> <ul> <li class="level1"> Use simple events as much as possible, they are faster than multi-track events.</li> <li class="level1"> Keep Max Playbacks to as few as possible, often the default 1 should suffice.</li> <li class="level1"> Do not add lots of effects to all events, it takes CPU. In particular never use reverb or similar, those should only be global and amount used by setting the dry/wet mix values (or use envelopes for dry/wet).</li> <li class="level1"> Preload projects/groups if needed to remove ingame stuttering when trying to play multiple sounds simultaneous.</li> </ul> </div> <h5>Groups</h5> <div class="level5"> <p> Groups are almost only for organizing your project. However it is useful to think it through how to group and sub-group your events, as you can use a script function to preload group(s). Preloading is useful if you for example notice that you want to play many sounds at the same time and the game stutters from this. By preloading the sounds the engine have the sounds ready in memory for usage. </p> </div> <h5>Categories</h5> <div class="level5"> <p> All sounds must be in one of two categories. These categories you have to create in each new project you make. It is only a matter of making a new category and naming it properly, there are no specific settings needed. </p> <ul> <li class="level1"> World - All sounds that should be affected by global effects, such as a reverb. For example if the player goes below surface then all the sounds around him should change.</li> <li class="level1"> Gui - All sounds that should not be affected by global effects. Simply no matter where the player is or what he does, these sounds are always the same. For example button clicking sounds for the menu.</li> </ul> </div> <h4>Physics sound</h4> <div class="level4"> <p> TODO: - ADD STUFF ABOUT MATERIALS.CFG AND HOW IT LINKS TO GROUPS, NAMES. </p> <p> The physics system now lets the sound system handle any mixing/effects for the sounds played. This is done by sending one or more parameters to the played sound. These are as follows: </p> <p> <b>Scrape</b> <br/> The event must have ONE param, name does not matter. The physics sends the linear speed to this param. Normal values 0 - 10. Is looping. </p> <p> <b>Roll</b> <br/> The event must have ONE param, name does not matter. The physics sends the angular speed (based on axes chosen in material) to this param. Normal values 0 - 10.Is looping. </p> <p> <b>Impact</b> <br/> The event must have two params named "mass" and "speed". "Speed" is sent the speed of impact (normal values 0 - 20). "Mass" is sent mass of the colliding object (normal values 0 - 200, but rarely over ~30) Note that mass is 0 for any static object no matter their size. </p> <p> <b>Joint</b> <br/> Move and Impact must have ONE param, where the speed is sent. Normal values are 0 - 5. </p> </div> <h4>Feet sounds</h4> <div class="level4"> <p> TODO: - ADD STUFF ABOUT MATERIALS.CFG - ADD ABOUT GROUP, NAMING AND HOW IT IS LINKED TO MATERIALS.CFG </p> </div> <h3>SNT (old sound system)</h3> <div class="level3"> <p> The old system of .snt files (see HPL2) is still in there and can be used, <b>it is not further developed and support might be dropped at anytime</b>. </p> </div> <h4>Supported audio file formats</h4> <div class="level4"> <p> You can use wav, mp3 or ogg audio files. OGG is what we used for Penumbra and Amnesia and should be considered the best choice due to its small size and is license free to use (unlike mp3). </p> </div> <h4>SntEditor.exe</h4> <div class="level4"> <p> Use this tool to create and edit .snt files. After you have run the tool the first time and selected Options → Register Application, you will get an option in the right-click menu if you click on a sound file in Windows Explorer. You can select one or many sounds when using the "Create Sound Entity file"-option and the editor will create several .snt files for each sound. If sounds are named the same, but with different numbers appended to the name, the editor will create a single .snt file for the group of sounds and the sounds will be added to the pool of sounds it randomly plays. <em>While the editor has input for Start and Stop sound these are actually not supported or working in HPL3.</em> </p> </div> <h5>Editor Settings</h5> <div class="level5"> <span class='np_break'> </span> <div class="table"><table class="inline"> <tr class="row0"> <td class="col0" colspan="4"><b>General</b></td> </tr> <tr class="row1"> <td class="col0" colspan="2"><b>Main Sound</b></td><td class="col2" colspan="2"> List the sound(s) that is played each time the .snt file is called by the game.</td> </tr> <tr class="row2"> <td class="col0" colspan="4"> </td> </tr> <tr class="row3"> <td class="col0" colspan="4"><b>Properties</b></td> </tr> <tr class="row4"> <td class="col0" colspan="2"><b>Loop</b></td><td class="col2" colspan="2"> If the .snt should loop.</td> </tr> <tr class="row5"> <td class="col0" colspan="2"><b>Use 3D</b></td><td class="col2" colspan="2"> When active a sound has a position in the world and moves around as the player moves around. If not set the sound is played at a static position, for example user interface sounds.</td> </tr> <tr class="row6"> <td class="col0" colspan="2"><b>Stream</b></td><td class="col2" colspan="2"> If stream, a sound will be streamed and played instantly. If not streaming, then it will first be loaded to memory and then played. Long sounds should use stream and short sounds should not. Do not use too many Streams, as they will crack and drop out if there are too many (at most 6 channels, that is 6 mono sounds).</td> </tr> <tr class="row7"> <td class="col0" colspan="2"><b>Blockable</b></td><td class="col2" colspan="2"> If an object is set to be blockable, the volume a sound located behind it will be lower when Blockable is active.</td> </tr> <tr class="row8"> <td class="col0" colspan="2"><b>Volume</b></td><td class="col2" colspan="2"> Volume of the sound, 0 to 1.</td> </tr> <tr class="row9"> <td class="col0" colspan="2"><b>Min Distance</b></td><td class="col2" colspan="2"> While the player is within this distance in meters from the sound source the volume will remain a the defined Volume, 0 to inf.</td> </tr> <tr class="row10"> <td class="col0" colspan="2"><b>Max Distance</b></td><td class="col2" colspan="2"> When the player is this far away in meters from the sound source the volume will be 0, 0 to inf.</td> </tr> <tr class="row11"> <td class="col0" colspan="2"><b>Block Volume</b></td><td class="col2" colspan="2"> Multiplier for the Volume. Block Volume * Volume = the sound volume when blocked by an object, if Blockable is active.</td> </tr> <tr class="row12"> <td class="col0" colspan="2"><b>Priority</b></td><td class="col2" colspan="2"> If the game runs out of sound channels, then lower priority sounds will be dropped in favor of higher priority sounds. A dialog should have high priority, but physics should have low priority.</td> </tr> </table> <span class='np_break'> </span> </div> </div>