Any views expressed within media held on this service are those of the contributors, should not be taken as approved or endorsed by the University, and do not necessarily reflect the views of the University in respect of any particular issue.

Group 2 Sound interaction

Sound Final Modification

After the show was finished, we made some more adjustments by analysing the feedback. For the music, I added two melodies, a piano piece and an ambient piece for the video clip background and the interview background music. To make the music more amplified, adjustments were made to MAX,

adding the amplitude of the music to make the connecting water tank ripples more visible and the changes in the water tank ripples more distinct with the rhythm of the music.

 Each beat of the music brings about an ebb and flow of the water. Combined with the images we have made, it allows the audience to be immersed in the beautiful music and enjoy the beautiful blend of water and music. As the climax of the music gradually approaches, the characters on the projector run faster and faster, and the amplitude of the water tank ripples increases, creating a beautiful wave of water as if it were an artistic painting. People followed the rhythm of the music and felt the beauty of it all as if they were immersed in a beautiful dream world. In this live experience, the effect of the images is not only created by the vibrations and intensity of the music but also changes according to the sound made by the audience through the microphone radio. Participants can shout, jump, snap their fingers, clap their hands, sing and other interactive ways to make the images change even more. This unique way of interacting with sound creates an overwhelmingly exciting, entertaining, and creative atmosphere. Finally, when the music slowly ended and the water tank ripples slowly calmed down, the whole space returned to peace and calm. This live experience gave them a musical and visual treat and a unique experience and enlightenment in their minds.

Layout & Adjustment

Jin booked many rooms at ECA and Evolution House to test the effects. For example, ECA C02, E15A, E15B, B55. Considering the shadows, and the effect of room size on sound and projection, we finally chose E15A as our final exhibition room. And three projectors were used. Sound to complete our final project. Starting to tune the software and change the details. Adjusting the order of the music in Max, etc. I created three clips, and after many tests, we chose to composite one for playback.

We started making the water tank, cutting the PVC sheets and glueing them with a glue gun, making the water tank, cutting the PVC sheet and glueing the PVC sheet with a glue gun and placing the water tank. We needed to shine the water tank at a 45-degree angle downwards and raise the tank. We wanted the tank to wobble slightly to add more water ripples, so we decided to hang hooks from the ceiling and the corners and use four wires to lift the tank. We then tested the height of the tank to see if it could support the lights, the speed of the drip unit, as well as the weight of the tank. Finally, we fixed the drip unit to the tank.


Sound test, adjusting the speaker position. As our room was small, I used a Bluetooth stereo and adjusted the position of the sound several times to hear where the sound was being produced. Then fit the water tank so that the amplitude affects the music. Different ripples are produced. Images are created not only by the vibrations and intensity of the music but also by the microphone radio, which changes according to the sounds made by the audience. The whole experience is fun as the audience shouts, jumps, snaps their fingers, claps, sings and otherwise interacts in ways that add to the variation of the images. The audience can stand in the room and interact by creating sounds, including singing, clapping and stamping their feet, and observing the corresponding changes created by the digital ripples. Front Life and Side Life are created by shooting two videos with the same content but at different angles, which are processed by MAX and then received through the camera as content-filled in-projected content. This video shows a slice of a person’s life, from walking alone, standing up after being provoked, falling, getting frustrated, being helped by a stranger, and having a friend to spend time with ……

As the room walls were rather messy, we hung curtains on the walls to ensure that the projection would be clean. We wound various coloured threads, and these twisted coloured lines represent the outside world’s influence on people. They are like various rules and potentially profound impressions that bind us and will always be projected at some point in our lives. At the same time, we have laid tinfoil underneath the water tank. We wanted to create a richer light and visual effect through its reflective effect. We are adjusting the angle of the light to test the water wave effect. Adjust the position of the computer so that Max recognises the projected image in real-time. Interpreting the images on the three walls

The water ripples consist of three projected walls and a device. The three projection walls are the projection of the inner world, the front and side views of life. The projection of the inner world is a sound visualisation created by the feedback function of TouchDesigner, which is based on the audio received by the microphone and the visual audio received by MAX generated by MAX, which shows the corresponding sound frequencies and intensities by the shape of the ripples.

 

 

Scenario testing

 

After these two weeks of constant adjustments and modifications, a version has now been formed. In terms of sound design, my initial idea was to make ambient music, but after testing it, I found that the sound was smooth and did not highlight the rhythm of the characters on screen。

屏幕录制2023-03-30 01.44.32

 

so I added sound effects to the design. I used four samples as the ambient background sound. I used four samples for the ambient soundtrack, which were some of the water and ambient sounds we recorded outside last week, and then three dotted tones, using footsteps and water drops to make a soundscape. Also to match the image you need to take into account the rhythm, beat, pitch, timbre, mood and theme.

Reflection:
Controlling tones with Max is extremely easy and simple. In MIDI music, the object “pgmout” sends the MIDI message
In MIDI music, the object “pgmout” sends the tone number in the MIDI message to the corresponding MIDI device for the purpose of changing the MIDI tone. In the case of audio samples and specific music
The large number of MSP objects included in Max makes it easy and efficient to perform ADSR envelope plotting, spectral content, and other functions on sound samples or real-time audio.
envelope plotting, spectral content adjustment, fast Fourier transforms, filtering, variable speed, playback, transposition, etc. to
The aim is to change the timbre of the audio.

In our work, we show three sections of people walking, running and galloping to map the inner musical combination of the characters. Considering tha the movement of the person walking, running and galloping has a certain rhythm to it, matching the footsteps of the walk to the rhythm of the drums. Ambient sound effects are used to enhance the music. More relevant to the theme.

Combine Touch Designer’s audio visualization with the device’s water ripple:

In our tests we used the Touch Designer’s to pick up the audio from the max to make the water drops change. To create an effect that matches the rhythm and intensity of the audio.

 

TRANSLATE with x

var LanguageMenu; var LanguageMenu_keys=[“ar”,”bg”,”ca”,”zh-CHS”,”zh-CHT”,”cs”,”da”,”nl”,”en”,”et”,”fi”,”fr”,”de”,”el”,”ht”,”he”,”hi”,”mww”,”hu”,”id”,”it”,”ja”,”tlh”,”ko”,”lv”,”lt”,”ms”,”mt”,”no”,”fa”,”pl”,”pt”,”ro”,”ru”,”sk”,”sl”,”es”,”sv”,”th”,”tr”,”uk”,”ur”,”vi”,”cy”]; var LanguageMenu_values=[“Arabic”,”Bulgarian”,”Catalan”,”Chinese Simplified”,”Chinese Traditional”,”Czech”,”Danish”,”Dutch”,”English”,”Estonian”,”Finnish”,”French”,”German”,”Greek”,”Haitian Creole”,”Hebrew”,”Hindi”,”Hmong Daw”,”Hungarian”,”Indonesian”,”Italian”,”Japanese”,”Klingon”,”Korean”,”Latvian”,”Lithuanian”,”Malay”,”Maltese”,”Norwegian”,”Persian”,”Polish”,”Portuguese”,”Romanian”,”Russian”,”Slovak”,”Slovenian”,”Spanish”,”Swedish”,”Thai”,”Turkish”,”Ukrainian”,”Urdu”,”Vietnamese”,”Welsh”]; var LanguageMenu_callback=function(){ }; var LanguageMenu_popupid=’__LanguageMenu_popup’;

TRANSLATE with
COPY THE URL BELOW
Back

EMBED THE SNIPPET BELOW IN YOUR SITE
Enable collaborative features and customize widget: Bing Webmaster Portal

var intervalId = setInterval(function () { if (MtPopUpList) { LanguageMenu = new MtPopUpList(); var langMenu = document.getElementById(LanguageMenu_popupid); var origLangDiv = document.createElement(“div”); origLangDiv.id = “OriginalLanguageDiv”; origLangDiv.innerHTML = “ORIGINAL: “; langMenu.appendChild(origLangDiv); LanguageMenu.Init(‘LanguageMenu’, LanguageMenu_keys, LanguageMenu_values, LanguageMenu_callback, LanguageMenu_popupid); window[“LanguageMenu”] = LanguageMenu; clearInterval(intervalId); } }, 1);

Audio recording

Recording equipment

 

  • l material selection
  • l High sample rate
  • l High audio quality

Recording Programme A.

Sound is a very important form of expression in a person’s life, and it can record a person’s growth from infancy to old age. It can be a valuable way of recording, as well as reminding people of past events and reflecting the preciousness and profundity of life.

  1. Infancy: the sound of a baby crying, lullabies in a cot, parents kissing, the sound of a warm family atmosphere.
  2. Adolescence: the sound of classes in school, the sound of activities on campus, the sound of students communicating, the sound of themselves at play, the sound of television or films.
  3. Middle age: ambient sounds at work, conversations in the home, children playing, sounds of family activities, the sound of music when you are relaxing and resting.
  4. Old age: sounds of family life, the company of family members, walking in the street, music while relaxing, sounds of natural landscapes.

 

Site reference.

Schools; meadows; sounds of people walking in the street

 

Recording Programme B:

Record the sounds of the natural environment at different times of the day or in different weather conditions, such as the sounds of nature, water currents, the sound of the wind on the beach, etc. These natural sounds can be recorded at different stages of life and in different situations, and can be poured into the max to create music that resonates with the audience.

 

Reflection

I bought a separate amplifier unit, soldered and assembled it, and ran a new test on Sunday as the previous test had not worked well.

 

The locations chosen for this recording were the Royal Botanic Gardens in Edinburgh and portobrllo beach, where the ambient sound was recorded. We capture the ambient sound as a basis for the music and edit it in max to create an ambient music. max is obviously the most important direction we should work on.

 

The microphone of choice is the Sennheiser – MKH60 – Shotgun – Hypercardioid, as hypercardioid microphones are often used when you need to pick up sound in noisy environments to accentuate your voice while reducing the effect of ambient noise on the recording. Ideal for recording ambient sound. Using a portable digital recorder, we chose a location close to a stream where there was not too much background noise. After continually adjusting the direction and height of the microphone, we found a location with better sound reception to better capture the sound of the water flow. The recording was edited and adjusted using protools.

 

 

 

 

 

 

 

 

 

 

 

Vibration Test

The first sound vibration test was carried out with the Subwoofer.

 

Test 1: We glued the pvc sheets together to form a square container. A suitable amount of water was poured in for the vibration test. The water only slightly produced some vibrations.

Reflection: The container was too thick and heavy for the vibrations of the sound to travel up and produce vibrations easily。

 

Test 2:A test using a plastic disc to produce vibrations. The water waves were very small and the overall effect was still not good.

Reflection: The container may still be too thick and heavy and needs to be replaced with a lighter container.

 

Test 3: A very thin plastic cup was used for the vibration test. The vibration was very strong and the water waves were obvious.

Reflection: The material of the container needs to be very thin and light so that the vibration will be strong.

Test 4: Sound vibration test with Subwoofer and Genelec-8040-speaker respectively. Using the transparent plastic plate, the vibrations are strong and the water waves are large. But splashes of water may affect the projection effect.

Reflection: The amount of water needs to be controlled, too much will diminish the vibrations, too little will produce a lot of splashing water droplets.

Test 5:Tested with a plastic bag, the vibration effect is good, but the material is too soft and deforms when water is poured in.

Reflection: The material is also too soft and may affect the projection effect. The choice of material is important in order not to affect the projection effect.

Original plan

The speaker is placed flat under a table with a container on top of it, on the diaphragm of the speaker, and water drops are placed in the container so that the drops create ripples through the sonic Hertzian vibrations of the music. We will take photographs of the water’s shadow and light and record some sounds. These photographs and sounds will be learned by the AI, such as Mubert-text-to-music, disco diffusion, and clip interrogator, and then the AI will produce some musical compositions. Before each stage begins, we invite the audience to pick a piece of music from the three sections we provide to influence the ripples.

Modified programme

We had a meeting to discuss our project. The original plan was to have three stages of music, a lot of pieces, but now we want to cut out the extra pieces,we can do two or three different kind of concepts and changes, Locations that kind of reflect different aspects of the journey of life right. The presentation of the movement of the characters in the picture is changed through different musical rhythms. The musical rhythm of a person walking can be steady and even. The musical rhythm of a runner should be faster than that of a walker and can be performed with a faster tempo. The musical rhythm of a fall is usually more chaotic and can be expressed by using irregular beats or by using some techniques such as staccato and pauses in the music. Life is like a long run, and we need to run persistently to achieve success. In the process of running, we may experience various difficulties and challenges, but as long as we always persist in our belief of moving forward, we will eventually reach the end of success.

 

we can tie into the distance sensor and use the distance sensor as a kind of responsive tool as well for the music and turn that up and down or maybe how proximity as away ,and Music .we initially intended that we could use artificial intelligence to generate audio. But then the opportunity to create dynamic, responsive work would be lost. So we would use max. and we wanted the end result to be, like

https://www.bilibili.com/video/BV1Si4y197Tx/?spm_id_from=333.337.search-card.all.click&vd_source=43a1873fafb51f0936b53c75c77f14f3

 Installation Reflection.

 The gap between the stereo and the container can only hold small bulbs. The effect of putting a small bulb under the container to cast is not very obvious. Perhaps we could make use of the water wave footage that was recorded in advance. By projecting this footage to the ai, the scene could be projected with some of the patterns generated by the ai. Two walls could be used, one projecting the projection of the installation and the other projecting the ai generated effect. It might be more interesting for the audience to experience two different effects at the same time by touching or sensing to make the projection and the music change.

 

 

Testing

We have been experimenting with materials through pre-material shopping. This Sunday we hired a room for our experiments and worked in groups to carry out the Water-holding Installation test, the colour reflection test, audio vibration test, and MAXMSP Music test. During this experiment, we encountered difficulties and problems that we had to solve, which made us struggle but we were able to reflect on them and move the project forward successfully. After analysing and reflecting on the results of the experiment, we optimised the design of the programme, the choice of materials, etc., and laid the foundations for the second experiment.

PART ONE: Water-holding Installation

What we want to achieve in this part is when the water is full of the water container, the water will flow away from the water container. We referred to a traditional Chinese container called “Fair Cup” (公道杯),  which  applies the Siphon Phenomenon.

There is a straw in a cup. The upper head of the straw is inside the cup, while the lower point is outside the cup. When the liquid level is higher than the upper head, the liquid will flow away from the straw.

We made a simple model for the container to test the function effect.

One problem we met was that the connecting hole of straw and cup was difficult to fit perfect and the water would flow away from the gap between the straw and the cup.

We used scissor to poke a hole in the cup, so it was hard to control the size of the hole. In the next week, I will try to use melt gun and hot melt adhesive to solve  this problem.


PART TWO: Colour Reflection Test

Purpose

To superimpose different color variations on the reflected water ripples.

Process

As the laser paper was on delivery, for this experiment we used colored PVC sheets to simulate the experiment. By coloring the transparent PVC sheet to simulate the laser paper, the light is reflected in different colors.

In this experiment, we used a highlighter and overlaid the transparent PVC sheet with red and blue colors, expecting the color of the light to change; we looked for the right visual effect by side-lighting the water ripples compared to bottom lighting.

Results

As the highlighter can only apply a thin layer of color on the transparent PVC sheet and the coloring is uneven. Therefore, the color change between the red and blue PVC sheets could be shown on the wall, but the effect was not obvious. And if we want the color to become more visible, we need to place the colored PVC sheet extremely close to the light. The problem of how to control the distance between the colored PVC sheet (or laser paper) and the light is therefore a problem to be solved.

By comparing the side lighting with the bottom lighting of water ripples, we found that the water ripples were more visible and visually better when the bottom lighting was applied to the water.

Problems

① How to make the color of the light reflection obvious on the wall;

② Comparison of the light reflection effect between the transparent PVC sheet and the laser paper;

③ How to control the distance between the transparent PVC sheet (or laser paper) and the light;

④ How to switch the color of the light reflection on the wall (switch the transparent PVC sheet or laser paper with color);

⑤ The position of the water ripple reflection on the wall.

Reflections and Improvements

Problem ①

In our next experiment, we wanted to increase the thickness of the color applied to the transparent PVC sheet to enhance the effect of the color of the light reflected on the wall. In this experiment, we used a highlighter to apply the color to the transparent PVC. However, the pigment of the highlighter did not adhere to the transparent PVC sheet, resulting in the only light coloring of the transparent PVC sheet. For the second trial, we will soak the transparent PVC sheet in a higher concentration of gouache paint to improve the purity of the color on the transparent PVC sheet.

Problem ②

We plan to compare the light reflections of the transparent PVC sheet with those of the laser paper in our next experiment, given the richer color reflections of the laser paper. At the same time, we will also color some of the radium paper to become a third control group. We will choose the material that reflects light better by comparison.

Problem ③

We design to add a transparent PVC sheet to the light and then place the colored transparent PVC sheet (or radium paper) on top of the transparent PVC sheet so that the colored transparent PVC sheet (or radium paper) is as close to the light as possible.

Problem ④

We envisage pasting different colored PVC sheets and laser paper on the transparent PVC sheet in the form of a collage, allowing the light to project different colors on the wall as it passes through the PVC sheet. (This effect will be simulated in a second trial).

Problem ⑤

By comparing the side lighting to the bottom lighting of the water ripples, we found that the effect of the water ripples was more obvious and visually better when the water was bottom lit. We, therefore, chose to light the bottom of the water to give a ripple effect. As the bottom of the water is lit, the effect of the light on the vertical wall will change with the angle of the light and is not as stable as the ripples on the top wall, but this conclusion is influenced by the size of the room. So we will experiment with this effect again in a later test.


PART THREE: Audio Vibration Test

  

Test 1: Take Bluetooth speakers for testing. First, take the glass for the vibration test. The glass was placed on the stereo, and the water did not vibrate.

Reason for failure: glass too thick, stereo too small, poor vibration.

Test 2: Take a Bluetooth speaker for testing. The container of choice is a mineral water bottle. The water in the bottle appears to vibrate and change with the music.

Reason for success: the container is thin, and the vibrations of the stereo can be transmitted up.

Reflection:

 It needs big speakers with great vibrations. If the container is too thick for the vibrations of the sound to be transmitted, try adding a spinning gear to the water. The speed of the gear can be varied in response to the music.


PART FOUR: MAXMSP Music Test

Reflection:

The music also needs to have some ambient and natural sounds added to it to make it more varied.

 

 

Group 2_Mar 4_Analysis and Reflection of other Installation Projects with Sound

Jalea and Yuan:

After receiving feedback from Philly on our sound design, we decided to broaden our understanding of audio-visual installation pieces and consider the following aspects:

Immersive experience: Our goal is to create sound environments that deeply engage the viewer and provide a unique experience, different from traditional visual art.

  • 1. Creative experimentation: We are interested in exploring the possibilities of audio processing, sound structure, and spatial design to push the boundaries of traditional music and sound art and create novel sonic experiences.
  • 2. Multiculturalism: We aim to cross-cultural and linguistic barriers and break genre restrictions by fusing different sound and music elements, achieving cross-cultural communication and integration.
  • 3. Social reflection: We recognize the power of sound in drawing attention to and reflecting on social issues. We hope to call for social concern and change by creating socially significant works.
  • 4. Environmental consciousness: We are interested in using sound materials from the environment to explore the sound properties and spatial nature of natural and man-made environments. Through our work, we hope to promote environmental protection and sustainable development.

Sound installation art is a unique art form that uses sound and music as its primary medium to provoke sensory and intellectual experiences in the viewer. It explores sound’s different properties and manifestations, leading to a deep and immersive artistic experience.

Project One: “Towards the reproduction of sound”

In the video Mediation: Towards the Reproduction of Sound, Hill starts sprinkling rice on a speaker and then speaks through the microphone himself at the same time, his voice emanating from the speaker’s loudspeaker, and the grains of rice bounce along with the sound waves, with different vibrations of rice in both high and low tones, as if they were many small intelligent creatures dancing as a whole under the direction of the artist’s words. Towards the end of the video, the rice grains completely bury the speakers of the speaker, covering the sound.

In this work, Hill is burying sound while talking to himself. The language of sound that he emits through the speakers actually describes this visualisation process. He uses the simplest of words to say things like “sound, speaker, hand”, and then these simple images of words appear to the viewer. Hill uses this experiment to show the audience that sound as a substance is real and can be seen and touched as the speakers you see in front of you and the artist’s hands.

Project Two: “Sonic Water

https://www.bilibili.com/video/BV1zd4y1z7Bj/?spm_id_from=333.337.search-card.all.click&vd_source=43a1873fafb51f0936b53c75c77f14f3

“Sonic Water” is an interactive installation experiment by KYMAT Laboratories in Germany that studies the visualization and vibration of sound and their ability to express sound aesthetically, transforming it into a fascinating visual experience.

Sonic Water is unique in its form and presentation as a sound installation. The artist has created a distinctive sound space and experience by combining water flow and sound. The work is also highly interactive, allowing viewers to alter the sound and form of the work through gestures and movements.

In terms of reflection on water resources, Sonic Water’s creative process involves using a significant amount of water resources. As we become increasingly concerned about environmental protection and sustainable development, it is essential to reflect on how to better utilise and protect water resources. Moreover, we should focus on how to use the process of creating artwork to call for environmental protection and promote awareness about water conservation.

Reflection:

For the sound installation of water droplets, focus on using the characteristics of the exhibition space and environment to build a more intimate and deeper relationship with the audience through the experience and perception of sound. The above similar works also make use of sound vibrations. Sound installation art is an art form and a process of creation and exploration. Using the sound of water droplets to stimulate human perception to create resonance and emotional resonance. By creating an organic sound space, the viewer can experience the power and emotion of sound through the auditory sensation of physical change. The work is driven and changed by the actions and reactions of the audience.

– MAXMSP-

MAXMSP is a powerful music creation and performance software that allows users to create various music and audio applications through a visual programming language. Learning MAXMSP requires some programming experience and musical knowledge. Although MAXMSP’s visual programming language is very intuitive, understanding basic programming concepts and musical principles is helpful in learning MAXMSP. This was a challenge for our group, but we were very interested.
This week we have learnt the basic MAX objects and operations and tried and practised a small part of them. And experimented with some simple linked music.

 

 

 

Process – Group 2 Submission 1

Process Group 2

List of group members:

Jin Qin (s2309515): Installation + Arduino coding + time control
Rudan Zheng (s2309043): Installation + Arduino coding + financial
Jaela Wang (s2417731): Video and editing + Installation + Equipments
Yuan Tian (s2453498): Music generation + Installation + pops

Initial Concept Generation

We confirmed our project keywords: Sound and AI. After a few days of brainstorming, we came up with some interesting preliminary ideas as follows:

  1. Sounds of the season: capturing the sounds of the seasons and synthesizing them into a piece of music with AI
  2. The world of color blindness: If I were a color blind person, could I experience the colorful world through sound
  3. Musical Puzzles: exploring whether someone who doesn’t know music can make a piece of music, through a collage (similar to a material puzzle, then synthesized with ai music)
  4. Musical visualization device: embodied music
  5. Vibrations of music (amplified) – water/vibrations of lines/line drawings/other media
  6. Music and Time: rhythm and the different frequencies of time, exploring whether music can change one’s perception of time
  7. A world of astigmatism: what would the world look like if I blurred your eyes (Using AI as an example, blur the image with hairy glass or water and use ai for analysis)

Among those ideas, we prefer the element of water, namely the fifth idea, and then we discussed the details and its way of realization.

Our initial scheme was:

A drop of water evaporates for 30 minutes. During the process, the vibration of sound will change the refraction of light, and display wonderful light and shadow exhibition. The process can be divided into three stages, similar to a person’s lifetime. Also, the music will be separated into three steps to cooperate with the changes. At the same time, there will be a projector for casting various environments and animation to create a more immersive experience for the audience.

In terms of sound design, the music is selected to represent the trajectory of different periods in life, using the vibrations of the speaker’s diaphragm to make contact with the wooden board, allowing a drop of water to resonate with the sound, which is perceived visually through the amplitude of the water drop’s rippling vibrations. Over time, the water droplets slowly and unconsciously evaporate, allowing for an association between perception and imagination, engaging the senses, and bringing about an interactive experience of time and space.

We collected some reference pictures and tutorials, and then created a mood board.

Dissection of “Process”

However, after our clarification to Jules on Thursday in week 3, Jules pointed out that our discussion was limited in the practical aspects, without the dissection of the concept of “Process” and the inclusion of AI. Therefore, we carried out an analysis of the concept of “Process” in two dimensions: the first one is the dissection of project content and connotation, and the second one is the dissection of the design process.

Dissection of the Process of our project Content

We analyzed the “Process” based on our initial concept of water projection. The analogy is applied to explain the project objects and connotations.

The water (the project object) is equivalent to me (the analogy object).

The dripping speed of the waterdrop represents the speed of my growth.

The size of the water in the container represents the extent of my development.

The light expresses society.

The beam of light striking the water means the influence of culture on us.

The vibration of sounds or music represents the influence of our family/others’ evaluation of us.

The light and shadow of water projected on the wall represent my image in the eyes of others.

The flow of water from less to more to none in this device shows the period of my life from birth to the completion of my sentence.

Dissection of our design process

AI artists are playing a more significant role in the art and Design field. Meanwhile, Hidden dangers and controversy are ensuing, such as the unclear copyright, the substitutability of AI artists to human artists, and the artistry of AI works of art. Therefore, we would like to discuss some questions:

  1. What role does AI play from the artist’s design process to the final production?
  2. Whether AI can replace artists in design or not?
  3. If AI intervenes in most of the content during the design process, can the final work touch the audience?

Under such questions, we designed a working flow to test the competition between AI artists and human artists through two controlled experiments.

Human Artist AI Artist
First Stage Take a series of photos, and create an animation based on the photos The series of images is fed to AI, and the AI artist outputs continuous pictures for animation
Second Stage Create music based on the animation created in the first stage Generate music based on the animation video feeding to AI like Clip Interrogator
Third Stage Exhibit two final composition works, and let the audience choose their favourite work
Final Preference

We prefer the dissection of the project content after analysis and plan on the two different understandings. From our perspective, AI is regarded as a tool for helping human artists broaden their minds. A personal initiative of a human artist is the reason for the origin and existence of art. In this case, we focus on our project content with AI working as a tool to compensate for our shortcomings. In addition, our work is expected to review social phenomena with social meaning rather than discuss “meaning”.

Besides, combining installation creation with coding is more challenging for us and needs to be tested, improved, deleted, and modified for the long term. For us, the process of challenging and creating is meaningful, so we will keep recording the project creation process.

The specific plan

Fig. 1. Text Flow of Project Process

Fig. 2. Picture Flow of Project Process

The installation includes a distance sensor. Once the audience approaches the sensor, the speaker, the light, and the water-dropping system start running. The speed of water dropping changes according to different stages. Ripples appear, and the speaker’s vibration can influence the water’s morphology and dynamics. Ray thought the laser paper and water project had notable water changes on the wall. When the water is full of the container installation, it will be poured away from the container. The whole process can be divided into three stages, where music and water-dropping speed are continuously changing.

Fig. 3. Graph of Relationship of Time and Speed of water-dropping

The speaker is placed flat under a table with a container, on top of the speaker’s diaphragm, water drops are placed in the container so that the drops create ripples through the sonic Hertzian vibrations of the music. We will take photos of the shadows and lights of the water and record some sounds. Those photos and sounds will be learned by AI, such as Mubert-text-to-music, disco diffusion, and clip interrogator, and then AI will generate some pieces of music. Before each stage starts, we invite an audience to pick one piece of music from the three parts we provide to influence the ripples.

Materials we need

Water, Mirror, Camera, Spotlights, Laser Paper, Transparent Container, Straws, Distance Sensor, Arduino Motherboard, Water-dropping Installation, Room without window or with curtain, Speaker, Speaker Diaphragm

Time Schedule

Week 1 – lecture

Week 2 – brainstorming, group discussion

Week 3 – modification and improvement of the project according to suggestions of Jules and Philly

Week 4 – decision on detailed design, material preparation and space lease

Week 5 & 6 – project testing, sound test, AI learning, installation design

Week 7 – testing in room

Week 8 & 9 & 10 – video editing, sound editing, Arduino coding and testing

Week 11 & 12 – complete testing

Week 13 – modification

Week 14 – final composition, video editing

Reference List

【TouchDesignerTutorials|Noise Creative Spin BallLeapMotion Gesture interaction】

https://www.bilibili.com/video/BV1EG4y1g72Z/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

【Audio-visual Interactive – Aurora_】

https://www.bilibili.com/video/BV1d84y1k723/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

【Processing–Blowing interaction】

https://www.bilibili.com/video/BV1PE411k7bf/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

【Plant sensory visualisation/A sketchy interactive installation】

https://www.bilibili.com/video/BV1LL4y1T7oG/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

【Interactive artwork AS IF】

https://www.bilibili.com/video/BV1hP4y1c7PN/?share_source=copy_web&vd_source=c0cd555c871b3d6c3923522ce3b0a1a8

【Simple Motion Visualisation –Simple motion visualisation can be done using Kinect】

https://www.bilibili.com/video/BV1Pd4y1o71B/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

【Touchdesigner Sound and picture interactive lines】

https://www.bilibili.com/video/BV1BV4y137kL/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

【 “Water” ambient light – Arduino design】

https://www.bilibili.com/video/BV18X4y1u7XP/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

 

 

css.php

Report this page

To report inappropriate content on this page, please use the form below. Upon receiving your report, we will be in touch as per the Take Down Policy of the service.

Please note that personal data collected through this form is used and stored for the purposes of processing this report and communication with you.

If you are unable to report a concern about content via this form please contact the Service Owner.

Please enter an email address you wish to be contacted on. Please describe the unacceptable content in sufficient detail to allow us to locate it, and why you consider it to be unacceptable.
By submitting this report, you accept that it is accurate and that fraudulent or nuisance complaints may result in action by the University.

  Cancel