Corey O'Hara
Video. Writing. Music.
MAX II: Return of the Max
For Class 3
For Class 4
Assignment 1
I used nodes to create a "room effect" mix for a song I've been working on. Using the arrow keys to navigate, user can shift the mix based on node positions. Additionally, Node 3 is a live mic via autotune, so the sonic texture is affected by user input.
Additionally, I used motion sensing to add random notes, but I was unsure how to connect that through the adc. It is pictured in the video (1:15) but the midi does not go through VB cable so it was not recorded.
Subpatchers
Next Steps
Next steps for this project are:
- Routing midi sounds through a new node, and possibly changing trigger to arrow key location.
- Recording midi sound through VB Cable.
- Applying this sound scape to VR environment (through Hubs?).
- More tracks (user-generated percussion? spoken word vox?)
For Class 7
Assignment 2
sunshine
tomorrow
I used the Class 6 multiple jit.gl.meshwarp lesson patcher as a template for my project. I sourced clips from Youtube and ran them through my effects and chroma subpatcher I made for previous projects. I used a white background so that the projection surfaces would also be lit, allowing for a clearer interplay between the images..
Here is the projection map (with black background for clarity).
Final Project: Initial Ideas
My initial idea for the final project is to create a speech-to-text-to-projection MAX patch. I have been playing around with creating a vocoder; I would like to integrate that into the final patcher, as well as integrate all these into the visual generators I made for my final project last semester. Ultimately I wanted to add speech-to-text-to-projection to my all-in-one video studio. I would also like a text-to-speech function.
Elements to explore:
- speech-to-text
- text-to-projection
- text-to-speech via vocoder)
- additional vocoder controls (chord switchers, key limiters)
- vocal generated imagery (by integration to last semester project & further exploration of OpenGL, shaders, textures etc)
- creating standalone apps from max patchers
Here are some screenshots of the vocodor patch I've been working on (will send you the patcher via email)
As you can see, the patcher has the option to put audio files into the vocoder, as well as use the microphone directly. I'd love to add a practical element of typing into the patcher and having it "read" it back to me. I also want to make the speech-to-text generate text automatically when I use the mic through the vocoder. I also need to create switches to turn on/off the "harmonies without having to edit the actual patcher.
FINAL PROJECT:
Streaming Performance VR Studio with Interactive Generative Visuals, Speech to Text, Vocodor
My final project is a fully functioning video streaming studio that generates it's own visuals which also react to sound, has auto-Text-to-speech, changes my speaking voice, and outputs straight to OBS (and then twitch, for the sake of my presentation)
Sample Performance
Patcher and Subpatchers
Patcher and Sub Patcher Descriptions
MAIN PATCH:
A link to all subpatchers. The switch is here to turn on the jit.grab. The matrices for thebackground 3D rendering is pulled from this camera.
MUSIC
Here the music is triggered (via keystroke) and the FOLLOWR vizzie object pulls out frequency info from each track.
BACKGROUND SUBPATCH:
This is where the 3D background is created. There are several line objects attached to key strokes to create zoom in/out visual effects. There is also a pak object that is attached to the music - when attached this object controls the scale axes for the background, creating visual patterns by interacting with music frequencies.
VOCODOR
The microphone is attached to pitchtuner then turned to midi and played thru the midi keyboard. I added some integers to create a chord. Additionally the meter from the mic will spin the axes of the entire background object.
SPEECH TO TEXT
Speech-to-text is set up to record then automatically bang the text out to the visuals. Everytime I record, the MOON subpatcher is also enacted. The microphone is also attached to the font size so that the font is bigger/closer when the mic is in use.
INSPO
Vocodor is combo of these:
- Delicious Max/MSP Tutorial 4: Vocoder
- Pitch Detection - Max/MSP Tutorial for Beginners
TTS
- From CLASS 12
Visual References:
- NED RUSH: Glitchy 3D visuals in Max 7
- Armando Gonzalez: Generating Visuals with jit.gl.pix
- Class 9: GL Bending: D_gl-alphamask-3layers-Mac.maxpat
- Video and Graphics Tutorial 5
- Max Tutorial 10: Chromakeying
WHAT's NEXT
I have to try this out in performance! I also want to try with a computer that is GOOD so I can see if the visuals look smoother. I want to set it up with my MOTU interface so that I can use live instrumentation to create the visuals. I also need to figure out a switch/option for the PAK object in the Background Subpatch (PAK seems to overide any other messeges when it is attached?). Also I want to incorporate multiple sources for a Multi-cam OBS live stream (getting into pirate TV!).