Week8
Based on the content of this week's Jules tutorial and Jules' advice to us, we have made further improvements to our design solution. By using Touch Designer and Max, we have increased the interactivity of the design and improved the visual effect of the design. Rudan and Jin were responsible for the part of Touch Designer, and Jeala and Yuan for the part of Max.
Design Development
Our design concept is a ‘human lifetime’ and the implementation is still water, sound and installation. But we wanted to achieve the effect of ‘audience-action/sound-installation-visuals’ interacting with each other and changing in real-time with the audience’s movement/sound, so we introduced Touch Designer and Max. The interaction flow is shown in the diagram below:
(This image was drawn by Rudan Zheng)
We plan to show different effects on the two walls, one wall shows people’s inner world, and the other wall shows people’s behavior and actions. These two walls are displayed together with the installation and the projector screen, which can interact with the audience in real-time.
It can be understood that we are showing a “person”, and the voice and behavior of every audience who comes to watch this “person” can have an impact on this person, and this influence will change the shape of the projection on the wall.
Rudan & Jin _Touch Designer
Reference:
- TOUCHDESIGNER TUTORIAL EDGE FEEDBACK – YouTube
- TOUCHDESIGNER TUTORIAL – COLOR MIXING AND DIFFERENT OUTCOMES – YouTube
- Abstract Speech Visualisation – TouchDesigner Tutorial 45 – YouTube
- Internal Audio to TouchDesigner – TouchDesigner Tips, Tricks and FAQs 10 – YouTube
Through learning some TD tutorials on Youtube and testing, we achieved the visualisation of sound in real-time. The input can be translated into flowing water, and changed based on the rhythm and strength.
Rudan’s First Test
Jin’s Second Version①
Jin’s Second Version②
I used VB-audio Virtual Cable as the input and output of sounds. Therefore we can change the music at any time, just change the music in spotify or youtube, without inputing music files into Touch Designer and use switch to change. Also, it can deal with sound from microphone, environment sounds and music in place and generate animations, which we would like to project on the water ripples created by our installation.
Besides, the colors and shapes of the water ripples in TD can be changed through ramp and displace components respectively (details can be found in video and pictures①②). The size of ripples can be changed by paramater multiply in maths component. The volume of music can also be flexible to adjust.
One obvious problem is the quality of sound, and until now I have no idea about how to improve this.