This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
tools:audiofrequency [2020/05/23 13:54] – [Interpolate] lightwolf | tools:audiofrequency [2020/05/30 16:22] – [Audio Frequency Node] lightwolf | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Audio Frequency Node (in progress) | + | ====== Audio Frequency Node ====== |
This node can load audio files (WAV, MP3, FLAC), performs a FFT ((Fast Fourier Transformation. In this case, Fourier analysis converts a signal from time to a representation in the frequency domain)) analysis on them and then provides the amplitudes at specific frequencies as nodal outputs. | This node can load audio files (WAV, MP3, FLAC), performs a FFT ((Fast Fourier Transformation. In this case, Fourier analysis converts a signal from time to a representation in the frequency domain)) analysis on them and then provides the amplitudes at specific frequencies as nodal outputs. | ||
Line 8: | Line 8: | ||
You can select frequencies or a range of frequencies couple with a variety of settings to fine tune the output for more specific use. | You can select frequencies or a range of frequencies couple with a variety of settings to fine tune the output for more specific use. | ||
+ | |||
+ | <WRAP center round info 80%> | ||
+ | The sample content includes three sample scenes as well as audio files that show how the Audio Frequency node and channel modifier can be used. | ||
+ | </ | ||
+ | |||
+ | {{youtube> | ||
+ | {{youtube> | ||
+ | |||
+ | |||
+ | |||
====== Technical Background ====== | ====== Technical Background ====== | ||
Line 26: | Line 36: | ||
- | {{ : | + | {{ : |
====== Controls ====== | ====== Controls ====== | ||
Line 46: | Line 56: | ||
This will load the currently selected audio file as the File used in Layout, allowing for playback of the audio file. | This will load the currently selected audio file as the File used in Layout, allowing for playback of the audio file. | ||
- | This will not work for some types of audio files, Layout seems to only support WAV and MP3 at 16-bit. | + | This will not work for some types of audio files, Layout seems to only support WAV and MP3 at 16-bit. It will also not match the audio offset if changed in the plugin, as there is no SDK access to that. |
===== Settings... ===== | ===== Settings... ===== | ||
Line 55: | Line 65: | ||
* **Single** This extracts the amplitude at a single frequency. | * **Single** This extracts the amplitude at a single frequency. | ||
- | * **Range** This extracts the amplitude within the range from Frequency to End Frequency. | + | * **Range |
+ | * **Range (Peak)** This extracts the peak amplitude within the range from Frequency to End Frequency. | ||
+ | * **Range (Smooth)** This extracts the average amplitude within the range from Frequency to End Frequency but smoothed with a curve that emphasises the frequencies in the middle of the range. | ||
When a frequency Range is selected, either the average, peak or smoothed average of the frequencies in the range will be computed. | When a frequency Range is selected, either the average, peak or smoothed average of the frequencies in the range will be computed. | ||
Line 69: | Line 81: | ||
If the Frequency mode is set to **Range**, this setting will control the end of the frequency range. The start is determined by the **Frequency** setting. | If the Frequency mode is set to **Range**, this setting will control the end of the frequency range. The start is determined by the **Frequency** setting. | ||
- | ===== Range Mode ===== | ||
- | |||
- | This determines how the amplitudes within a frequency range are accumulated: | ||
- | * **Average** The average of the amplitudes within the range is used. | ||
- | * **Peak** The largest amplitude is used | ||
- | * **Smooth** Similar to average, but the amplitudes are weighed in a bell curve, giving more emphasis to the amplitudes in the middle of the frequency range. | ||
===== Max. Level (dB) / Min. Level (dB) ===== | ===== Max. Level (dB) / Min. Level (dB) ===== | ||
Line 101: | Line 107: | ||
* **Peak** The amplitude will be the highest over a range of frames | * **Peak** The amplitude will be the highest over a range of frames | ||
* **Smooth** The amplitude will be the average over a range of frames with an emphasis on the amplitudes closer to the current frame | * **Smooth** The amplitude will be the average over a range of frames with an emphasis on the amplitudes closer to the current frame | ||
+ | |||
+ | ===== Frames +/- ===== | ||
+ | If Time Blending is anything except for off, this allows you to changed the number of frames around the current frame to average the amplitude. | ||
+ | |||
Line 240: | Line 250: | ||
---- | ---- | ||
- | ====== Spectrum Picker ====== | + | {{ : |
- | {{ : | + | ====== Spectrum Picker ====== |
The Spectrum Picker allows for the graphical selection of a frequency or a range of frequencies. It can be launched from any of the plugins and is non-modal ((Which basically means it can stay open)). | The Spectrum Picker allows for the graphical selection of a frequency or a range of frequencies. It can be launched from any of the plugins and is non-modal ((Which basically means it can stay open)). | ||
Line 258: | Line 268: | ||
===== Controls ===== | ===== Controls ===== | ||
These mirror the controls in the plugin the picker was called from. | These mirror the controls in the plugin the picker was called from. | ||
+ | |||
+ | ---- | ||
+ | {{ : | ||
+ | ====== Audio Frequency Channel Modifier ====== | ||
+ | |||
+ | |||
+ | The Audio Frequency channel modifier shares most controls with the node. We'll just document the additional controls here: | ||
+ | |||
+ | ===== Output ===== | ||
+ | This controls the value that's returned by the channel modifier, these correspond to the node outputs: | ||
+ | |||
+ | * **Waveform** The audio waveform, in the range from -1 .. 1.0 | ||
+ | * **Amplitude** The amplitude for the selected frequency or frequency range | ||
+ | * **Bass** The amplitude for the range from 20Hz-140Hz | ||
+ | * **Mid-Bass** The amplitude for the range from 140Hz-400Hz | ||
+ | * **Mid** The amplitude for the range from 400Hz-2.6kHz | ||
+ | * **Upper Mid** The amplitude for the range from 2.6kHz-5.2kHz | ||
+ | * **High** The amplitude for the range from 5.2kHz-24kHz | ||
+ | |||
+ | ===== Audio Channel ===== | ||
+ | |||
+ | This allows you to select an specific audio channel or the master channel (which is the average of all channels in the audio file). | ||
+ | |||
+ | ===== Channel Mode ===== | ||
+ | |||
+ | This determines how the output of the channel modifier affects the envelope, taking the original envelope value into account: | ||
+ | |||
+ | * **Replace** Replaces the envelope by the output of the modifier | ||
+ | * **Add** Adds the output of the modifier to the envelope value | ||
+ | * **Multiply** Multiplies the output of the modifier by the envelope value | ||
+ | * **Channel - Audio** Subtracts the modifier value from the envelope value | ||
+ | * **Audio - Channel** Subtracts the envelope value from the channel value | ||