db&w documentation wiki

finest software | finest docs

Site Tools


tools:audiofrequency

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
tools:audiofrequency [2020/05/23 13:27] – [Preview] lightwolftools:audiofrequency [2020/09/11 11:42] (current) – [Spectrum (norm)] lightwolf
Line 1: Line 1:
-====== Audio Frequency Node (in progress) ======+====== Audio Frequency Node ======
  
 This node can load audio files (WAV, MP3, FLAC), performs a FFT ((Fast Fourier Transformation. In this case, Fourier analysis converts a signal from time to a representation in the frequency domain)) analysis on them and then provides the amplitudes at specific frequencies as nodal outputs. This node can load audio files (WAV, MP3, FLAC), performs a FFT ((Fast Fourier Transformation. In this case, Fourier analysis converts a signal from time to a representation in the frequency domain)) analysis on them and then provides the amplitudes at specific frequencies as nodal outputs.
Line 8: Line 8:
  
 You can select frequencies or a range of frequencies couple with a variety of settings to fine tune the output for more specific use. You can select frequencies or a range of frequencies couple with a variety of settings to fine tune the output for more specific use.
 +
 +<WRAP center round info 80%>
 +The sample content includes three sample scenes as well as audio files that show how the Audio Frequency node and channel modifier can be used.
 +</WRAP>
 +
 +{{youtube>n5AO4p_ZNy8?medium}}
 +{{youtube>6s6zimffKlg?medium}}
 +
 +
 +
  
 ====== Technical Background ====== ====== Technical Background ======
Line 24: Line 34:
  
 Once the frequencies have been binned per frame and stored in a cache, the result of the FFT is deleted. The audio file is ready to be used. Once the frequencies have been binned per frame and stored in a cache, the result of the FFT is deleted. The audio file is ready to be used.
 +
 +<WRAP center round important 80%>
 +When either of the plugins are used in Modeler, a fps of 30 is assumed since the scene fps is not available. This may affect loading a motion path saved in Layout to be used in Modeler as well.
 +
 +The fps is used to determined the number of spectrum samples stored in memory per second (one set of samples per frame). If the fps in your scene is different, the result in Modeler will be different as well (especially if interpolate is off).
 +
 +In that case, baking in Layout is the only way to get a 100% accurate representation.
 +</WRAP>
 +
  
  
-{{ :tools:pasted:20200523-123858.png}}+{{ :tools:pasted:20200526-150317.png}}
  
 ====== Controls ====== ====== Controls ======
Line 46: Line 65:
 This will load the currently selected audio file as the File used in Layout, allowing for playback of the audio file. This will load the currently selected audio file as the File used in Layout, allowing for playback of the audio file.
  
-This will not work for some types of audio files, Layout seems to only support WAV and MP3 at 16-bit.+This will not work for some types of audio files, Layout seems to only support WAV and MP3 at 16-bit. It will also not match the audio offset if changed in the plugin, as there is no SDK access to that.
 ===== Settings... ===== ===== Settings... =====
  
Line 55: Line 74:
  
   * **Single** This extracts the amplitude at a single frequency.   * **Single** This extracts the amplitude at a single frequency.
-  * **Range** This extracts the amplitude within the range from Frequency to End Frequency.+  * **Range (Average)** This extracts the average amplitude within the range from Frequency to End Frequency
 +  * **Range (Peak)** This extracts the peak amplitude within the range from Frequency to End Frequency. 
 +  * **Range (Smooth)** This extracts the average amplitude within the range from Frequency to End Frequency but smoothed with a curve that emphasises the frequencies in the middle of the range.
  
 When a frequency Range is selected, either the average, peak or smoothed average of the frequencies in the range will be computed. When a frequency Range is selected, either the average, peak or smoothed average of the frequencies in the range will be computed.
Line 68: Line 89:
  
 If the Frequency mode is set to **Range**, this setting will control the end of the frequency range. The start is determined by the **Frequency** setting. If the Frequency mode is set to **Range**, this setting will control the end of the frequency range. The start is determined by the **Frequency** setting.
 +
 +
  
 ===== Max. Level (dB) / Min. Level (dB) ===== ===== Max. Level (dB) / Min. Level (dB) =====
Line 84: Line 107:
  
 This interpolates the values in the bins depending on the frequency, smoothing out the result. This interpolates the values in the bins depending on the frequency, smoothing out the result.
 +
 +===== Time Blending =====
 +
 +This setting will average the amplitude around the current frame, making changes to it less sudden and extreme.
 +
 +  * **Off** To time blending will take place
 +  * **Average** The amplitude will be the average over a range of frames
 +  * **Peak** The amplitude will be the highest over a range of frames
 +  * **Smooth** The amplitude will be the average over a range of frames with an emphasis on the amplitudes closer to the current frame
 +
 +===== Frames +/- =====
 +If Time Blending is anything except for off, this allows you to changed the number of frames around the current frame to average the amplitude.
 +
 +
  
 ===== Time Offset (s) ===== ===== Time Offset (s) =====
Line 114: Line 151:
 ===== Spectrum (norm) ===== ===== Spectrum (norm) =====
  
-Similar to **Frequency (norm)**, this input actually used the Octave bins as opposed to the frequencies. This will lead to a much more pleasant distribution if it's used to colour items based on an index or displace vertices depending on their position.+Similar to **Frequency (norm)**, this input actually uses the Octave bins as opposed to the frequencies. This will lead to a much more pleasant distribution if it's used to colour items based on an index or displace vertices depending on their position.
  
-===== Frequency Range ===== 
  
-If the Frequency mode is set to Single + Extent, this setting will control the extent of the range. It will be subtracted/added to the Frequency. 
 ===== End Frequency ===== ===== End Frequency =====
  
Line 163: Line 198:
  
  
 +----
 ====== Settings ====== ====== Settings ======
  
Line 222: Line 258:
 Recomputes the FFT for all audio files. This is required if the Frames per Second is changed for the current scene. Recomputes the FFT for all audio files. This is required if the Frames per Second is changed for the current scene.
  
-====== Spectrum Picker ======+---- 
 +{{ :tools:pasted:20200526-150601.png}}
  
-{{ :tools:pasted:20200523-131338.png}}+====== Spectrum Picker ======
  
 The Spectrum Picker allows for the graphical selection of a frequency or a range of frequencies. It can be launched from any of the plugins and is non-modal ((Which basically means it can stay open)). The Spectrum Picker allows for the graphical selection of a frequency or a range of frequencies. It can be launched from any of the plugins and is non-modal ((Which basically means it can stay open)).
Line 240: Line 277:
 ===== Controls ===== ===== Controls =====
 These mirror the controls in the plugin the picker was called from. These mirror the controls in the plugin the picker was called from.
 +
 +----
 +{{ :tools:pasted:20200526-143811.png}}
 +====== Audio Frequency Channel Modifier ======
 +
 +
 +The Audio Frequency channel modifier shares most controls with the node. We'll just document the additional controls here:
 +
 +===== Output =====
 +This controls the value that's returned by the channel modifier, these correspond to the node outputs:
 +
 +  * **Waveform** The audio waveform, in the range from -1 .. 1.0
 +  * **Amplitude** The amplitude for the selected frequency or frequency range
 +  * **Bass** The amplitude for the range from 20Hz-140Hz
 +  * **Mid-Bass** The amplitude for the range from 140Hz-400Hz
 +  * **Mid** The amplitude for the range from 400Hz-2.6kHz
 +  * **Upper Mid** The amplitude for the range from 2.6kHz-5.2kHz
 +  * **High** The amplitude for the range from 5.2kHz-24kHz
 +
 +===== Audio Channel =====
 +
 +This allows you to select an specific audio channel or the master channel (which is the average of all channels in the audio file).
 +
 +===== Channel Mode =====
 +
 +This determines how the output of the channel modifier affects the envelope, taking the original envelope value into account:
 +
 +  * **Replace** Replaces the envelope by the output of the modifier
 +  * **Add** Adds the output of the modifier to the envelope value
 +  * **Multiply** Multiplies the output of the modifier by the envelope value
 +  * **Channel - Audio** Subtracts the modifier value from the envelope value
 +  * **Audio - Channel** Subtracts the envelope value from the channel value
  
  
tools/audiofrequency.1590233256.txt.gz · Last modified: 2020/05/23 13:27 by lightwolf