Project 3: Grand Finale

 For this last project, I decided to do Option 1 which was creating an interaction with live video and audio input. I wanted to create something with both the camera and an imported audio file, and continue the theme of song visualization from a previous project. I decided on using optical flow to create circle particles based on camera movement, and those circles/background would react to the beat of the audio file. 

Aesthetic-wise, I stuck with one color on the circles to avoid it feeling overwhelming - but ensured the background flashed red each time there was a dramatic beat in the music. To prevent it flashing the entire screen, I used a Ramp TOP with a circular type so it's noticeable but not overwhelming. Meanwhile, the motion circles would scale based on the volume of the sound - small when there's a break in the music, and larger when the sound is in rhythm.

Interaction-wise, it's just the camera motion so the performance is hands-free. I considered adding an additional interaction to change how the background pattern looks when there's a beat in the music, but thought it might overcomplicate things. I enjoy the simplicity of how it detects motion and responds to the audio with both beat and volume. 






Comments

Post a Comment

Popular posts from this blog

Exercise 1: Mood Mix

Image
 For Exercise 1, I wanted to include a playful mood with animals. The videos I selected were ones I've taken on my phone: a squirrel at a park in Rochester and a dolphin at a resort in Hawaii. I knew I wanted to include colors on both videos, so the Ramp operator was needed in TouchDesigner. The overall network flow intended was as follows: Movie File → Ramp → Text → Cross for both videos. Once the videos with text and colors met at the Cross operator, that's when its value would be controlled by a slider.   Aesthetic-wise, I chose a blue color to represent the ocean for the Dolphin, and a green color for the grass in the Squirrel video. I swapped those colors for the text to make it stand out - green for Dolphin and blue for Squirrel. Interaction-wise, I chose a slider because it's quite simple to manually control exactly how far you'd like to go between the videos. The Cross value reads the value of the slider with a Python expression: op('slider1').par.value0...
Read more

Exercise 2: Control Blue

Image
 For this exercise with the blue theme, I wanted to have a slider that controlled the saturation of blue, and some type of cool texture effect to trigger with a button as well. After playing around with lots of the TOPs, I decided on the Edge operator to outline edges. For the slider, it controlled the Low Blue parameter of the Level operator, which was then sent into the Edge operator to control the shade of blue on the edges. For the button, it changed the strength parameter of the Edge operator.  Network flow-wise, I intended on having the video itself come out of its own container: just the movie file. A level up, that video would get its Level and Edge operators which would be controlled by the slider and button. Another level up, it would be sent to a Null operator and into a content container, before another container would combine both the controls and content. Lastly, it was put into the window. In terms of choices, I chose a video I took on top of a mountain in Vermo...
Read more

P1 - Resonant Viz

Image
   For this project, I took inspiration from an audio visualizer project in another class and decided to make another song-based creation. I decided on a list of songs for the data - alongside information such as their moods (valence), energy, danceability, and genre - which gave me lots of flexibility in terms of how to visualize it. I knew I wanted to have a control to select songs and decided on a separate control to select the genre as well.    When it came to the experience, I wanted almost a graph of different quadrants for different songs to move to based on selection - happy songs to the right, sad to the left, those with high "danceability" on top, and those more serious/calm on the bottom. I also wanted more ways to represent vibe/movement - the songs scaling based on energy (intense as large vs. peaceful as small), the background changing based on valence (happy as yellow, sad as blue), and noise/movement on the song/shape also demonstrating how "danceable...
Read more