The first part of the project is the introduction to the scene in terms of sound that both fits the specific movements of the characters and conveys the depressingly low atmosphere contained in the images. The two main parts of the recorded sound samples are the two phases of the human voice, the multiple whispers and the single chant, and the recording of sounds with a sense of movement and rhythm with the objects used for filming.

Recording

Objects used: balloons, cloth curtains, woollen balls, piano, etc.

Equipment used: Sennheiser – MKH60, Zoom – F8, AKG – C414B XLS Pair

Time: 22nd March afternoon

Below is a selection of the recorded sounds.

 

Crafting

After sorting through all the recorded sounds, adding filters, reverbs, delays, and other effects makes the sounds more in tune with the narrative qualities.

from cloth curtains

double voices

voice with oVox

 

 

Mixing

Writing the musical parts, adding musical elements such as synth, violin, bass and piano to build the plot development of the images.

Interactive sound

In the first stage of the performance, an actor will play the role of a mother on set, feeding in an angry accusatory voice against her daughter in the picture in real time, the vocal will affect the picture and give it a distorted effect.

 

Mar 30, 2023

Kinect and TD test

Our group started working on our show mainly in three different directions. Firstly, the second part of our whole show involved motion capture, so we continued with Kinect and TD
Combined test, the 1st generation Kinect we rented before could not perform motion capture due to system problems. This week we bought a 2nd generation Kinect and initially completed the motion capture.

Sound creates

 

Flim edited

We made a preliminary edit of the video shot last week, and this part will be used in the first part of our performance. The interactive form is a live recording using live sound, and the change of the picture is realized through TD

Mar 23, 2023

 

The first part of our performance-interaction experiment film

Interactive form – sound control screen to achieve distortion and other effects
Software-Touch designer

Brief-We use the red line as a metaphor to represent the relationship between the daughter and the mother in the film, which runs through the entire first part of the experimental images.

Storyboard

 

 

19/3/2023

We filmed live, and here are the images we took on location, we completed the video content for the first part of the show, and then we needed to test the interaction between TD and video and sound.

 

 

Kinect test

17/3/2023

The second part of our performance uses motion capture, so we tested the Kinect; we will combine the Kinect and TD to achieve motion capture during the actor’s performance at the same time. Still, when we tested in the window system, we found that there is a problem with the Kinect can not be displayed; we still need to test further. If it proves that the Kinect can not be used by us, we can only use the ordinary camera, in the scene with light to achieve the motion capture.

 

Mar 20, 2023

Suggestions for the addition of visual presentation and projections in the feedback, as well as restrictions on-site use, were considered
The performance form is changed from 3 links to 1 link, and our design focuses on the interaction of sound and dynamics
visual content
-Technical-level processing and touch designer-abstract particle content
-Narrative content-Experimental video

possible element use
-broken mirror
– white curtain
-Wire
– bell

We plan to change the final performance mode, we reduced the originally planned 3 sessions to 1, and we started to think and make the initial visual effects this week. We first experimented with Processing.

Experimental video reference

Mar 5, 2023