Displacement Funky

AE Particles

New Pattern

With Color

Star Pattern

Keyboard Bump Map

Trapcode SoundKeys

Using the Trapcode Soundkeys plugin for After Effects I am able to display the frequencies much more effectively than with the Audio Spectrum Effect plugin.  The box seen in the video can be translated and scaled in the scene.  When one of the frequency bars overlaps the box it creates an output value.  This value can then be used to generate keyframes.

Maya Integration 2

Maya Integration

This video shows me using the audio spectrum effect within Maya.  I used Mocha to track the guitar of the character in my thesis project.  I then used After Effects to composite it together.

Displacement Test

As a test I used one of the renders from After Effects and plugged its RGB values into the color and displacement of a sphere in Maya.

After Effects Render - Song: Waves

Changing the audio and using the same file with a few adjustments to the Audio Spectrum.

Same song different results

Using the same song as the previous post I adjusted the settings and made the mask into a circle. So far this is my favorite result because I have the range of RGB values around the circle. I think this will work better than my previous results in Maya.

After Effects Render - Song: Will

This is an original piece of music I wrote a couple months ago. With the audio in After Effects I used Audio Spectrum for the visuals. This is a render I will bring into Maya to drive a shader.

Audio Spectrum Effect Test 2

Driving the colors on a granite texture.

Render example from After Effects:

Audio Spectrum Effect Test 1

Importing the audio into after effects and linking it with the Audio Spectrum Effect. I rendered an image sequence out of After Effects and drove the "implode" and "ratio" settings of a volume noise.

The images rendered in After Effects look like this:

Early Progress

With my initial tests I used the bonus tool Audiowave in Maya. I ran into issues while batch rendering because the textures I was driving were not responding to the audio. Also, the node created within Maya did not have a value for frequency, only amplitude.

I am currently using the Audio Spectrum plugin within After Effects. I can create visuals based on the frequency of the audio and there are multiple values that can be adjusted to achieve a number of results.

Project Overview

My goal for this project is to use original audio tracks to drive assets in Maya. Driving visuals with the amplitude is straight forward and doesn't reflect the mood of the piece. By incorporating the frequency I intend to create Maya assets that carry the mood of the music.