db&w documentation wiki

finest software | finest docs

Site Tools


tools:audiofrequency

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
tools:audiofrequency [2020/05/23 13:55] – [Time Blending] lightwolftools:audiofrequency [2020/09/11 11:42] (current) – [Spectrum (norm)] lightwolf
Line 1: Line 1:
-====== Audio Frequency Node (in progress) ======+====== Audio Frequency Node ======
  
 This node can load audio files (WAV, MP3, FLAC), performs a FFT ((Fast Fourier Transformation. In this case, Fourier analysis converts a signal from time to a representation in the frequency domain)) analysis on them and then provides the amplitudes at specific frequencies as nodal outputs. This node can load audio files (WAV, MP3, FLAC), performs a FFT ((Fast Fourier Transformation. In this case, Fourier analysis converts a signal from time to a representation in the frequency domain)) analysis on them and then provides the amplitudes at specific frequencies as nodal outputs.
Line 8: Line 8:
  
 You can select frequencies or a range of frequencies couple with a variety of settings to fine tune the output for more specific use. You can select frequencies or a range of frequencies couple with a variety of settings to fine tune the output for more specific use.
 +
 +<WRAP center round info 80%>
 +The sample content includes three sample scenes as well as audio files that show how the Audio Frequency node and channel modifier can be used.
 +</WRAP>
 +
 +{{youtube>n5AO4p_ZNy8?medium}}
 +{{youtube>6s6zimffKlg?medium}}
 +
 +
 +
  
 ====== Technical Background ====== ====== Technical Background ======
Line 24: Line 34:
  
 Once the frequencies have been binned per frame and stored in a cache, the result of the FFT is deleted. The audio file is ready to be used. Once the frequencies have been binned per frame and stored in a cache, the result of the FFT is deleted. The audio file is ready to be used.
 +
 +<WRAP center round important 80%>
 +When either of the plugins are used in Modeler, a fps of 30 is assumed since the scene fps is not available. This may affect loading a motion path saved in Layout to be used in Modeler as well.
 +
 +The fps is used to determined the number of spectrum samples stored in memory per second (one set of samples per frame). If the fps in your scene is different, the result in Modeler will be different as well (especially if interpolate is off).
 +
 +In that case, baking in Layout is the only way to get a 100% accurate representation.
 +</WRAP>
 +
  
  
-{{ :tools:pasted:20200523-123858.png}}+{{ :tools:pasted:20200526-150317.png}}
  
 ====== Controls ====== ====== Controls ======
Line 46: Line 65:
 This will load the currently selected audio file as the File used in Layout, allowing for playback of the audio file. This will load the currently selected audio file as the File used in Layout, allowing for playback of the audio file.
  
-This will not work for some types of audio files, Layout seems to only support WAV and MP3 at 16-bit.+This will not work for some types of audio files, Layout seems to only support WAV and MP3 at 16-bit. It will also not match the audio offset if changed in the plugin, as there is no SDK access to that.
 ===== Settings... ===== ===== Settings... =====
  
Line 55: Line 74:
  
   * **Single** This extracts the amplitude at a single frequency.   * **Single** This extracts the amplitude at a single frequency.
-  * **Range** This extracts the amplitude within the range from Frequency to End Frequency.+  * **Range (Average)** This extracts the average amplitude within the range from Frequency to End Frequency
 +  * **Range (Peak)** This extracts the peak amplitude within the range from Frequency to End Frequency. 
 +  * **Range (Smooth)** This extracts the average amplitude within the range from Frequency to End Frequency but smoothed with a curve that emphasises the frequencies in the middle of the range.
  
 When a frequency Range is selected, either the average, peak or smoothed average of the frequencies in the range will be computed. When a frequency Range is selected, either the average, peak or smoothed average of the frequencies in the range will be computed.
Line 69: Line 90:
 If the Frequency mode is set to **Range**, this setting will control the end of the frequency range. The start is determined by the **Frequency** setting. If the Frequency mode is set to **Range**, this setting will control the end of the frequency range. The start is determined by the **Frequency** setting.
  
-===== Range Mode ===== 
- 
-This determines how the amplitudes within a frequency range are accumulated: 
  
-  * **Average** The average of the amplitudes within the range is used. 
-  * **Peak** The largest amplitude is used 
-  * **Smooth** Similar to average, but the amplitudes are weighed in a bell curve, giving more emphasis to the amplitudes in the middle of the frequency range. 
  
 ===== Max. Level (dB) / Min. Level (dB) ===== ===== Max. Level (dB) / Min. Level (dB) =====
Line 136: Line 151:
 ===== Spectrum (norm) ===== ===== Spectrum (norm) =====
  
-Similar to **Frequency (norm)**, this input actually used the Octave bins as opposed to the frequencies. This will lead to a much more pleasant distribution if it's used to colour items based on an index or displace vertices depending on their position.+Similar to **Frequency (norm)**, this input actually uses the Octave bins as opposed to the frequencies. This will lead to a much more pleasant distribution if it's used to colour items based on an index or displace vertices depending on their position.
  
  
Line 244: Line 259:
  
 ---- ----
-====== Spectrum Picker ======+{{ :tools:pasted:20200526-150601.png}}
  
-{{ :tools:pasted:20200523-131338.png}}+====== Spectrum Picker ======
  
 The Spectrum Picker allows for the graphical selection of a frequency or a range of frequencies. It can be launched from any of the plugins and is non-modal ((Which basically means it can stay open)). The Spectrum Picker allows for the graphical selection of a frequency or a range of frequencies. It can be launched from any of the plugins and is non-modal ((Which basically means it can stay open)).
Line 262: Line 277:
 ===== Controls ===== ===== Controls =====
 These mirror the controls in the plugin the picker was called from. These mirror the controls in the plugin the picker was called from.
 +
 +----
 +{{ :tools:pasted:20200526-143811.png}}
 +====== Audio Frequency Channel Modifier ======
 +
 +
 +The Audio Frequency channel modifier shares most controls with the node. We'll just document the additional controls here:
 +
 +===== Output =====
 +This controls the value that's returned by the channel modifier, these correspond to the node outputs:
 +
 +  * **Waveform** The audio waveform, in the range from -1 .. 1.0
 +  * **Amplitude** The amplitude for the selected frequency or frequency range
 +  * **Bass** The amplitude for the range from 20Hz-140Hz
 +  * **Mid-Bass** The amplitude for the range from 140Hz-400Hz
 +  * **Mid** The amplitude for the range from 400Hz-2.6kHz
 +  * **Upper Mid** The amplitude for the range from 2.6kHz-5.2kHz
 +  * **High** The amplitude for the range from 5.2kHz-24kHz
 +
 +===== Audio Channel =====
 +
 +This allows you to select an specific audio channel or the master channel (which is the average of all channels in the audio file).
 +
 +===== Channel Mode =====
 +
 +This determines how the output of the channel modifier affects the envelope, taking the original envelope value into account:
 +
 +  * **Replace** Replaces the envelope by the output of the modifier
 +  * **Add** Adds the output of the modifier to the envelope value
 +  * **Multiply** Multiplies the output of the modifier by the envelope value
 +  * **Channel - Audio** Subtracts the modifier value from the envelope value
 +  * **Audio - Channel** Subtracts the envelope value from the channel value
  
  
tools/audiofrequency.1590234945.txt.gz · Last modified: 2020/05/23 13:55 by lightwolf