Jin booked many rooms at ECA and Evolution House to test the effects. For example, ECA C02, E15A, E15B, B55. Considering the shadows, and the effect of room size on sound and projection, we finally chose E15A as our final exhibition room. And three projectors were used. Sound to complete our final project. Starting to tune the software and change the details. Adjusting the order of the music in Max, etc. I created three clips, and after many tests, we chose to composite one for playback.

We started making the water tank, cutting the PVC sheets and glueing them with a glue gun, making the water tank, cutting the PVC sheet and glueing the PVC sheet with a glue gun and placing the water tank. We needed to shine the water tank at a 45-degree angle downwards and raise the tank. We wanted the tank to wobble slightly to add more water ripples, so we decided to hang hooks from the ceiling and the corners and use four wires to lift the tank. We then tested the height of the tank to see if it could support the lights, the speed of the drip unit, as well as the weight of the tank. Finally, we fixed the drip unit to the tank.

Sound test, adjusting the speaker position. As our room was small, I used a Bluetooth stereo and adjusted the position of the sound several times to hear where the sound was being produced. Then fit the water tank so that the amplitude affects the music. Different ripples are produced. Images are created not only by the vibrations and intensity of the music but also by the microphone radio, which changes according to the sounds made by the audience. The whole experience is fun as the audience shouts, jumps, snaps their fingers, claps, sings and otherwise interacts in ways that add to the variation of the images. The audience can stand in the room and interact by creating sounds, including singing, clapping and stamping their feet, and observing the corresponding changes created by the digital ripples. Front Life and Side Life are created by shooting two videos with the same content but at different angles, which are processed by MAX and then received through the camera as content-filled in-projected content. This video shows a slice of a person’s life, from walking alone, standing up after being provoked, falling, getting frustrated, being helped by a stranger, and having a friend to spend time with ……

As the room walls were rather messy, we hung curtains on the walls to ensure that the projection would be clean. We wound various coloured threads, and these twisted coloured lines represent the outside world’s influence on people. They are like various rules and potentially profound impressions that bind us and will always be projected at some point in our lives. At the same time, we have laid tinfoil underneath the water tank. We wanted to create a richer light and visual effect through its reflective effect. We are adjusting the angle of the light to test the water wave effect. Adjust the position of the computer so that Max recognises the projected image in real-time. Interpreting the images on the three walls

The water ripples consist of three projected walls and a device. The three projection walls are the projection of the inner world, the front and side views of life. The projection of the inner world is a sound visualisation created by the feedback function of TouchDesigner, which is based on the audio received by the microphone and the visual audio received by MAX generated by MAX, which shows the corresponding sound frequencies and intensities by the shape of the ripples.

After these two weeks of constant adjustments and modifications, a version has now been formed. In terms of sound design, my initial idea was to make ambient music, but after testing it, I found that the sound was smooth and did not highlight the rhythm of the characters on screen。

屏幕录制2023-03-30 01.44.32

so I added sound effects to the design. I used four samples as the ambient background sound. I used four samples for the ambient soundtrack, which were some of the water and ambient sounds we recorded outside last week, and then three dotted tones, using footsteps and water drops to make a soundscape. Also to match the image you need to take into account the rhythm, beat, pitch, timbre, mood and theme.

Reflection:
Controlling tones with Max is extremely easy and simple. In MIDI music, the object “pgmout” sends the MIDI message
In MIDI music, the object “pgmout” sends the tone number in the MIDI message to the corresponding MIDI device for the purpose of changing the MIDI tone. In the case of audio samples and specific music
The large number of MSP objects included in Max makes it easy and efficient to perform ADSR envelope plotting, spectral content, and other functions on sound samples or real-time audio.
envelope plotting, spectral content adjustment, fast Fourier transforms, filtering, variable speed, playback, transposition, etc. to
The aim is to change the timbre of the audio.

In our work, we show three sections of people walking, running and galloping to map the inner musical combination of the characters. Considering tha the movement of the person walking, running and galloping has a certain rhythm to it, matching the footsteps of the walk to the rhythm of the drums. Ambient sound effects are used to enhance the music. More relevant to the theme.

Combine Touch Designer’s audio visualization with the device’s water ripple:

In our tests we used the Touch Designer’s to pick up the audio from the max to make the water drops change. To create an effect that matches the rhythm and intensity of the audio.

TRANSLATE with x

English

Arabic	Hebrew	Polish
Bulgarian	Hindi	Portuguese
Catalan	Hmong Daw	Romanian
Chinese Simplified	Hungarian	Russian
Chinese Traditional	Indonesian	Slovak
Czech	Italian	Slovenian
Danish	Japanese	Spanish
Dutch	Klingon	Swedish
English	Korean	Thai
Estonian	Latvian	Turkish
Finnish	Lithuanian	Ukrainian
French	Malay	Urdu
German	Maltese	Vietnamese
Greek	Norwegian	Welsh
Haitian Creole	Persian

var LanguageMenu; var LanguageMenu_keys=[“ar”,”bg”,”ca”,”zh-CHS”,”zh-CHT”,”cs”,”da”,”nl”,”en”,”et”,”fi”,”fr”,”de”,”el”,”ht”,”he”,”hi”,”mww”,”hu”,”id”,”it”,”ja”,”tlh”,”ko”,”lv”,”lt”,”ms”,”mt”,”no”,”fa”,”pl”,”pt”,”ro”,”ru”,”sk”,”sl”,”es”,”sv”,”th”,”tr”,”uk”,”ur”,”vi”,”cy”]; var LanguageMenu_values=[“Arabic”,”Bulgarian”,”Catalan”,”Chinese Simplified”,”Chinese Traditional”,”Czech”,”Danish”,”Dutch”,”English”,”Estonian”,”Finnish”,”French”,”German”,”Greek”,”Haitian Creole”,”Hebrew”,”Hindi”,”Hmong Daw”,”Hungarian”,”Indonesian”,”Italian”,”Japanese”,”Klingon”,”Korean”,”Latvian”,”Lithuanian”,”Malay”,”Maltese”,”Norwegian”,”Persian”,”Polish”,”Portuguese”,”Romanian”,”Russian”,”Slovak”,”Slovenian”,”Spanish”,”Swedish”,”Thai”,”Turkish”,”Ukrainian”,”Urdu”,”Vietnamese”,”Welsh”]; var LanguageMenu_callback=function(){ }; var LanguageMenu_popupid=’__LanguageMenu_popup’;

TRANSLATE with

COPY THE URL BELOW

Back

EMBED THE SNIPPET BELOW IN YOUR SITE

Enable collaborative features and customize widget: Bing Webmaster Portal

Back

var intervalId = setInterval(function () { if (MtPopUpList) { LanguageMenu = new MtPopUpList(); var langMenu = document.getElementById(LanguageMenu_popupid); var origLangDiv = document.createElement(“div”); origLangDiv.id = “OriginalLanguageDiv”; origLangDiv.innerHTML = “ORIGINAL: “; langMenu.appendChild(origLangDiv); LanguageMenu.Init(‘LanguageMenu’, LanguageMenu_keys, LanguageMenu_values, LanguageMenu_callback, LanguageMenu_popupid); window[“LanguageMenu”] = LanguageMenu; clearInterval(intervalId); } }, 1);