Frictional Game Wiki

<h2>Sound</h2> <div class="level2"> </div> <h3>FMOD</h3> <div class="level3"> <p> HPL3 uses FMOD to handle all sound playback. See <a href="http://fmod.org" class="urlextern" title="http://fmod.org" rel="nofollow">fmod.org</a> for more details, documentation and help. When working with sounds it is mainly the <a href="http://fmod.org/fmod-downloads.html" class="urlextern" title="http://fmod.org/fmod-downloads.html" rel="nofollow">FMOD Designer tool</a> that will be of interest, the easiest way to learn how it works is to check the tutorials in <a href="http://www.youtube.com/user/FMODTV" class="urlextern" title="http://www.youtube.com/user/FMODTV" rel="nofollow">FMOD's YouTube channel</a>. </p> </div> <h4>General</h4> <div class="level4"> <p> It is important to plan and think through how to split up your sounds into different projects. The game will load sounds based on this, it will help you find your sounds, it will ease preloading if you need to use that and so on. </p> </div> <h5>Project</h5> <div class="level5"> <p> Create a project for large chunks of sound types, for example a project for each character, level or for physics. Each project can contain many groups of sound events, preferably a hierarchy of 1-2 sub-groups will make it organized and easy to work with when for example optimizing. More details about this is found under FMOD Designer Events. Some type of sounds need to follow a special structure and naming convention! See the sections below, for example physics and footsteps. </p> </div> <h5>Banks</h5> <div class="level5"> <p> A bank stores all the sounds for a project, you can have many banks but you should normally only need two. One bank for sounds that you load into memory to play and one bank that streams sounds from the harddrive and plays them. Special cases where you need to have more banks would be if you have sounds that are localized to different languages, where you have one bank for each language. </p> <p> Sounds to be streamed are usually longer sounds, such as a looping ambient track or voices. Be cautious with using streamed sounds, streams depend on the speed of the harddrive, so what works well for you might not be so for another user. Try to keep the number of simultaneous streams to something low, perhaps max 6 streams. Remember that music and dialog streams, so could easily be 3 streams if you have a cross-fade of music going when a voice is played. </p> </div> <h5>Example files</h5> <div class="level5"> <p> Our releases always have all the final FMOD project files in the game sound/ folder. The actual source sound files are not included, but you can view the projects and see how they are organized and what settings are used for reference. </p> </div> <h4>FMOD Designer Sound Defs</h4> <div class="level4"> <p> A sound def is the settings for a sound (or set of sounds for variation) that you can use in your Multi-track events. There is nothing specific to keep in mind for these, do as suitable and follow the FMOD documentation. </p> </div> <h4>FMOD Designer Events</h4> <div class="level4"> <p> The Events are what you actually use when playing sounds in the engine. The events are what replaces our old system of playing a SNT file, which essentially worked in the same way as Simple Events. When working with events there are a few things to keep in mind, mainly to organize events into easy to navigate groups and to use categories to send the events to be processed (or not processed) by the proper global effects. </p> </div> <h5>Simple Event</h5> <div class="level5"> <p> Nothing in particular to keep in mind beyond the basic usage as specified by the FMOD documentation. Just check our general important notes for events and performance concerns for info on why you should use simple events and any minor specific setting you might need to set. </p> </div> <h5>Multi-track Event</h5> <div class="level5"> <p> These events allow for parameters to affect the sound in a detailed manner, for example changing the sound of an impact depending on the speed of the object or much more advanced mixes. Make sure to view Performance concerns for Events to not overdo it. These events replace what previously was set with a lot of parameters in the snt editor, model editor and level editor for sounds. The move to FMOD makes it possible for a sound designer to do much more without any engine specific knowledge or assistance from a programer/scripter. </p> <p> Following is a quick overview of events, for more details check FMOD documentation and tutorials. </p> <p> An event is created with layers, a layer can contain one or many Sound Defs. At first glance it is much like any sound editor, but as you begin to make your first event you notice that what normally is a representation of time is not so in the context of making FMOD Events. </p> <p> To be able to move your sounds around you will need to right-click the top of the event and add a parameter. The parameter can represent numerous things, such as time or the engine sending in a value with the speed of an object. These parameters can be used to make envelope mixes and different sound def play depending on the value of a parameter or mix of parameters. For example see physics, the engine sends in the speed and mass of an object, the speed sets the volume and what type of sound def to play and the mass is used to change the pitch of the sounds (increased mass = lower pitched sound). </p> <p> Let's say we have a machine in the game and the player will be able to start and stop this machine. A single event can be created to be used for this, where we first play a sound as the machine starts up, then loops a sound while it is running and finally plays a sound as it stops. </p> <ol> <li class="level1"> Right-click the top and add a parameter to the event, the name does not matter.</li> <li class="level1"> Right-click the parameter and choose parameter properties, set Velocity to 1. This will make the event play like in a typical sound editor.</li> <li class="level1"> Right click on your layer and add in three sounds defs. This should be a start sound, a loop sound and a stop sound. </li> <li class="level1"> Right-click on the start and stop sound defs and choose Sound instance properties… Set Loop mode to oneshot (as in do not loop).</li> <li class="level1"> Play the event, make sure it plays the start, loop and then stop sounds in correct order as you like. If you like, drag the sound defs a bit over each other and they will automatically cross-fade.</li> <li class="level1"> To test envelopes, right-click the section to the left (where it says layer00) and Add effect. Choose Volume.</li> <li class="level1"> Right-click on the red envelope line to add points that you can use to fade the sound. Play the sound and notice that it fades the sound after the envelope, just like in a sound editor.</li> <li class="level1"> Right-click the "timeline" (parameter value line) and add a sustain point somewhere in the looping sound. Play the sound and notice that it stays and loops the looping sound at the sustain point.</li> <li class="level1"> Press the key off button and notice how the event move along and plays the stop sound and then ends.</li> </ol> <p> From this simple example you can see (hear) the possibilities that are available to you as the sound designer to create interesting and easy to use sound events. This event would allow the person scripting to simply play the sound as the player starts the machine, it would automatically begin to loop for as long as the machine is running and then as the player stops the machine the script would stop the sound (which triggers key off) and the sound stops with playing the stop sound as you designed it. </p> <p> <b>Envelopes, volume and 3D parameters</b> <br/> There are three special parameters for 3D that you can use for events, right-click the parameter bar and you'll see Add 3D … parameter. These allow you to do typical things, such as fading a sound depending on the distance from the source. This you most of the time don't want to do, you rather simply use the 3D Min Distance and 3D Max Distance values for the event as a whole. But say you want a sound that fades out, but as it reaches a certain distance it stays at a certain volume, for this you have to do your own envelopes. </p> <p> <u>If you make your own envelopes you have to change 3D Rolloff to Custom</u> or else the envelopes for Volume and/or Occlusion will not be used. You can also leave the 3D Min/Max distance values to 0. </p> <p> <u>Don't forget to change the parameter property to have the correct value for the distance</u> you want, the default is 0 to 1, which ingame would mean that the sound only reaches 1 meter. Right-click on the distance parameter, choose Parameter Properties and set the Minimum/Maximum value to what you want them to be. </p> </div> <h5>Groups</h5> <div class="level5"> <p> Groups are almost only for organizing your project. However it is useful to think it through how to group and sub-group your events, as you can use a script function to preload group(s). Preloading is useful if you for example notice that you want to play many sounds at the same time and the game stutters from this. By preloading the sounds the engine have the sounds ready in memory for usage. </p> </div> <h5>Categories</h5> <div class="level5"> <p> All sounds must be in one of two categories. These categories you have to create in each new project you make. It is only a matter of making a new category and naming it properly, there are no specific settings needed. </p> <ul> <li class="level1"> World - All sounds that should be affected by global effects, such as a reverb. For example if the player goes below surface then all the sounds around him should change.</li> <li class="level1"> Gui - All sounds that should not be affected by global effects. Simply no matter where the player is or what he does, these sounds are always the same. For example button clicking sounds for the menu.</li> </ul> </div> <h5>FMOD files & how engine access them</h5> <div class="level5"> <p> When you have a project of sounds that you want to use in the game you use the Build… option in the project menu. You can uncheck everything except that banks that you want to build. After building the project you take the .fsb (bank) files and the .fev (project) file and put them in the games sound/ folder at a suitable location. </p> <p> Most of the time sounds will be picked from menus, using the tools for the engine (that is the plan, at the time of this writing this functionality does not exist.). If you manually have to specify a sound to be played, in for example a config file, a script file or in a input field allowing only to type in text this is how you do it. </p> <p> Specify the full path to the sound, where it begins with the name of the project (the .fev file) and ends with the name of the event. For example for a physics impact that would be "physics/metal/compact/impact". Footsteps defined in the material.cfg file has an exception from this! See the Footstep sounds section. </p> </div> <h5>Important notes for Events</h5> <div class="level5"> <ul> <li class="level1"> Make sure that all events that should be looped are set to "Oneshot" <b>false</b>. If not, there might be all sort of strangeness in the sound playback.</li> <li class="level1"> Use unique names for all projects, as the .fev file it creates with the same name, must be unique for it to work correctly.</li> <li class="level1"> For looping (non "Oneshot") sounds that are to be in the environment, like fire from a torch, always use "just fail if quietest" max playback behavior. This will make sure that if there are many sounds of the same type around the player, it will be the loudest once that are heard. Other options are possible, but using any of the "steal" ones are almost always a bad choice.</li> <li class="level1"> Must use Gui or World category, see categories section.</li> </ul> </div> <h5>Performance concerns for Events</h5> <div class="level5"> <ul> <li class="level1"> Use simple events as much as possible, they are faster than multi-track events.</li> <li class="level1"> Keep Max Playbacks to as few as possible, often the default 1 should suffice.</li> <li class="level1"> Do not add lots of effects to all events, it takes CPU. In particular never use reverb or similar, those should only be global and amount used by setting the dry/wet mix values (or use envelopes for dry/wet).</li> <li class="level1"> Preload projects/groups if needed to remove ingame stuttering when trying to play multiple sounds simultaneous.</li> </ul> </div> <h4>Physics sound</h4> <div class="level4"> <p> The physics system lets the sound system (FMOD) handle any mixing/effects for the sounds played. This is done by sending one or more parameters to the Multi-track Event for a sound. These are as follows: </p> <p> <b>Scrape</b> <br/> The event must have ONE param, name does not matter. The physics sends the linear speed to this param. Normal values 0 - 10. Is looping. </p> <p> <b>Roll</b> <br/> The event must have ONE param, name does not matter. The physics sends the angular speed to this param. Normal values 0 - 10. Is looping. </p> <p> <b>Impact</b> <br/> The event must have two params named "mass" and "speed". "Speed" is sent the speed of impact (normal values 0 - 20). "Mass" is sent mass of the colliding object (normal values 0 - 200, but rarely over ~30) Note that mass is 0 for any static object no matter their size. </p> <p> <b>Joint</b> <br/> Move and Impact must have ONE param, where the speed is sent. Normal values are 0 - 5. </p> </div> <h5>Materials.cfg</h5> <div class="level5"> <p> This file is located in the root (top) folder of the game installation, next to the game executable. The file can be edited in a text editor and it lists all the different types of material available to use by textures and objects in the game (ie makes something that looks like gravel behave and sound like gravel). </p> <p> Parameters that are for a sound that you can define are always ending with SoundName = "". Currently there are three sounds: Roll, Scrape and Impact. As you can see they are specified by giving the full path to a sound event, beginning with the project name and ending with the event name. </p> <p> The parameter called StepType has the same value as the name of the event to play. For this to work you have to make sure that the footstep events are put in the correct project, in the correct groups and with the correct names. See Footstep sounds section. </p> </div> <h5>Specific settings for physics</h5> <div class="level5"> <p> There are some specific parameter values to keep in mind for physics sounds. </p> <p> <b>General</b> </p> <ul> <li class="level1"> Max playbacks should be 2, possibly higher if you experience issues with sounds cutting out. Keep as low as possible.</li> <li class="level1"> Mode is 3D.</li> <li class="level1"> Min, Max Distance values should not be very far. Min: 0.5, Max: at most 30.</li> <li class="level1"> Priority should be low for physics, it is not important to have sounds from physics if channels run out, things like voices are much more important.</li> </ul> <p> <b>Scrape</b> </p> <ul> <li class="level1"> Fade in/Fade out Time must be 100-300ms to avoid stuttering sounds.</li> </ul> <p> <b>Roll</b> </p> <ul> <li class="level1"> Fade in/Fade out Time must be 300-500ms to avoid stuttering sounds.</li> </ul> </div> <h4>Footstep sounds</h4> <div class="level4"> <p> Footsteps are defined in the material.cfg file, with the StepType parameter. The footsteps and script for it has been designed to work in the following manner: </p> <ul> <li class="level1"> Events are in a "player" project.</li> <li class="level1"> At the top there is an event group called "footsteps", in it are event groups called "barefoot", "sneaker" and "default".</li> <li class="level1"> Events for each type of material, with the same name as the StepType parameter value are located as needed in each type of foot type (barefoot, sneaker, default).</li> <li class="level1"> A parameter called movement in each event, with a value from 0 to 3.</li> <li class="level1"> Sound defs for sneak, walk and run.</li> <li class="level1"> The three step types has been laid out evenly, sounds should be reaching like this: sneak 0-1, walk 1-2 and run 2-3.</li> </ul> <p> The engine checks what material the player is in contact with and what type of footwear the player has. This is then put together to a string and appends the value of the StepType parameter from the materials.cfg file. It sends the string, which is the location for a footstep event (ie player/footsteps/barefoot/stone), and also checks the current player movement (sneak, walk or run) value and sends that as the parameter value. This allows FMOD to play the different movement sounds for that particular material. </p> </div> <h3>SNT (old sound system)</h3> <div class="level3"> <p> The old system of .snt files (see HPL2) is still in there and can be used, <b>it is not further developed and support might be dropped at anytime</b>. </p> </div> <h4>Supported audio file formats</h4> <div class="level4"> <p> You can use wav, mp3 or ogg audio files. OGG is what we used for Penumbra and Amnesia and should be considered the best choice due to its small size and is license free to use (unlike mp3). </p> </div> <h4>SntEditor.exe</h4> <div class="level4"> <p> Use this tool to create and edit .snt files. After you have run the tool the first time and selected Options → Register Application, you will get an option in the right-click menu if you click on a sound file in Windows Explorer. You can select one or many sounds when using the "Create Sound Entity file"-option and the editor will create several .snt files for each sound. If sounds are named the same, but with different numbers appended to the name, the editor will create a single .snt file for the group of sounds and the sounds will be added to the pool of sounds it randomly plays. <em>While the editor has input for Start and Stop sound these are actually not supported or working in HPL3.</em> </p> </div> <h5>Editor Settings</h5> <div class="level5"> <span class='np_break'> </span> <div class="table"><table class="inline"> <tr class="row0"> <td class="col0" colspan="4"><b>General</b></td> </tr> <tr class="row1"> <td class="col0" colspan="2"><b>Main Sound</b></td><td class="col2" colspan="2"> List the sound(s) that is played each time the .snt file is called by the game.</td> </tr> <tr class="row2"> <td class="col0" colspan="4"> </td> </tr> <tr class="row3"> <td class="col0" colspan="4"><b>Properties</b></td> </tr> <tr class="row4"> <td class="col0" colspan="2"><b>Loop</b></td><td class="col2" colspan="2"> If the .snt should loop.</td> </tr> <tr class="row5"> <td class="col0" colspan="2"><b>Use 3D</b></td><td class="col2" colspan="2"> When active a sound has a position in the world and moves around as the player moves around. If not set the sound is played at a static position, for example user interface sounds.</td> </tr> <tr class="row6"> <td class="col0" colspan="2"><b>Stream</b></td><td class="col2" colspan="2"> If stream, a sound will be streamed and played instantly. If not streaming, then it will first be loaded to memory and then played. Long sounds should use stream and short sounds should not. Do not use too many Streams, as they will crack and drop out if there are too many (at most 6 channels, that is 6 mono sounds).</td> </tr> <tr class="row7"> <td class="col0" colspan="2"><b>Blockable</b></td><td class="col2" colspan="2"> If an object is set to be blockable, the volume a sound located behind it will be lower when Blockable is active.</td> </tr> <tr class="row8"> <td class="col0" colspan="2"><b>Volume</b></td><td class="col2" colspan="2"> Volume of the sound, 0 to 1.</td> </tr> <tr class="row9"> <td class="col0" colspan="2"><b>Min Distance</b></td><td class="col2" colspan="2"> While the player is within this distance in meters from the sound source the volume will remain a the defined Volume, 0 to inf.</td> </tr> <tr class="row10"> <td class="col0" colspan="2"><b>Max Distance</b></td><td class="col2" colspan="2"> When the player is this far away in meters from the sound source the volume will be 0, 0 to inf.</td> </tr> <tr class="row11"> <td class="col0" colspan="2"><b>Block Volume</b></td><td class="col2" colspan="2"> Multiplier for the Volume. Block Volume * Volume = the sound volume when blocked by an object, if Blockable is active.</td> </tr> <tr class="row12"> <td class="col0" colspan="2"><b>Priority</b></td><td class="col2" colspan="2"> If the game runs out of sound channels, then lower priority sounds will be dropped in favor of higher priority sounds. A dialog should have high priority, but physics should have low priority.</td> </tr> </table> <span class='np_break'> </span> </div> </div>