Any views expressed within media held on this service are those of the contributors, should not be taken as approved or endorsed by the University, and do not necessarily reflect the views of the University in respect of any particular issue.

Group 2_Material Preparation 2

At the end of the test, we felt we needed to acquire some new props as well as update some of them to achieve better visual effects.

Water Tank

The size of the previous tank was too small, resulting in a black edge on the wall caused by the edge of the tank blocking the light when the water ripples were projected on the wall. Therefore, I decided to replace the water tank with an a3 size.

I purchased a 2mm thick sheet of 420 mm*297 mm clear PVC on eBay to make the bottom of the tank, and two 1mm thick sheets of 420 mm*297 mm clear PVC to make the four sides of the tank. I then cut these clear PVC sheets with a hobby knife, as well as using a glue gun to glue the five cut PVC sheets to make a sealed clear water tank.

Fortunately, the a3 size tank was just right for our needs. And the ripples in this tank project nicely on the wall.

Line

Considering that we wanted to show the complexity of emotions within people, I decided to use some thread to decorate the room for the exhibition. I purchased some fine sewing thread for hanging the water tank up, as it is only when the tank is at a certain height that the light can cast ripples through it onto the walls. I then brought out some of my hand-knitting threads in different colours, which intertwine in the room to create a better visual effect.

Bells

The bells can be used as a way for a person to interact with the device. The bells are attached to a wire and when a person touches the wire, the bells make sounds. These sounds can be blended perfectly with ambient sounds and can give the audience a sense of touch. In other words, the taut wire symbolises the sensitivity of the human heart, which is affected by the touch of others.

 

Group 2_Character Movement Animation & Pr

Character Movement Animation

We re-shot the video of the people walking. The frontal walk as well as the side walk were filmed in multiple views.

I then imported the two videos into Capcut and used the video auto key feature to snap out the characters and make the character silhouettes black. After completing the two black character silhouette videos, I imported the videos into PR to make adjustments to both videos so that all the character actions in both videos were at the same point in time.

I added a background image to the side movement video of the characters, which was taken from an open source AI image. I tweaked and created that type of footage in PR to complete the background of the movement. The side video of the character was merged with this motion background to complete the side video.

These two videos will later be imported into Max and used to capture footage on location.

Heart keying

Create an alpha channel heart video that can correspond to the silhouette of a person in frontal movement, enabling live capture in Max.

Reference

Free vector: Parallax background with Autumn Forest and Lake (2021) Freepik. Available at: https://www.freepik.com/free-vector/parallax-background-with-autumn-forest-lake_21087491.htm#query=2d%20forest%20background&position=26&from_view=search&track=ais (Accessed: April 26, 2023).

Free vector: Silhouette shadow of forest scene (2022) Freepik. Available at: https://www.freepik.com/free-vector/silhouette-shadow-forest-scene_27282385.htm#page=2&query=2d%20forest%20background&position=18&from_view=search&track=ais (Accessed: April 26, 2023).

Pin on quick saves (2023) Pinterest. Available at: https://www.pinterest.jp/pin/710020697526232615/ (Accessed: April 26, 2023).

Group 2_Character Movement Animation-Video capture&Video Editing

Character Movement Animation Video capture

Because before I only shot a video of a person moving, but the projection effect was not ideal too monotonous. Philly suggested we make it more graphic. So we decided to re-shoot some of the characters and cut them together.

 

I use the button function in the editing software to select the text. Change the background to white. By adjusting the brightness of the curve, the figure becomes a black silhouette. After editing, I drag and drop this video into Max and apply it.

Group 2_Installation Performance, Max, Pr

Rudan

This week we test the effectiveness of the installation. The tests include the sound visualisation effect of max audio imported into Touch Designer, the effect of the installation’s water projection in combination with Touch Designer and the reworking of the projected image on the wall by max.

Based on the following flow chart, I was involved in optimising and practising the various sections. This includes testing in the field, optimisation of the effects of the installation, integration of the sound visualisation generated by Touch Designer with Max and editing of the Max video.

(This image was drawn by Rudan Zheng)

Wall One is used to representing the abstract inner world of the characters, using Touch Designer to recognise the audio to produce a sound visualisation.

Combining Touch Designer’s audio visualisation with the device’s water ripple:

To make the water ripples fit the projection better and to add colour to the ripples, I placed translucent sheets made of laser paper collage in front of the projector.

The effect of Wall 1 is as follows:

Wall II we use to show the real world of the characters and is therefore more figurative. The projection of wall one is recognised by Max, overlaid with the silhouette of the figure to create the image, and projected onto wall two. However, as the figure is too small and due to the distance captured by the computer camera, the actual effect is not as obvious as it would appear on the computer.

Philly gives us advice in the tutorial. On the one hand, the silhouettes of the people are too monotonous, on the other hand, we can try to capture the wall images with other equipment. So, we shot additional silhouettes of people. Based on the silhouette video we shot, I added a background to the video to increase the area available on Max for capturing the wall and to enrich the animation of the silhouette on the other hand.

The silhouettes of the people were generated in Max, and I created two different backgrounds for the scenes in Pr.

I combined the silhouette of the character with the sound visualisation generated by Touch Designer to achieve the following effect, which is also the desired one:

 

Put the figure in the max and combine it with the footage captured by the camera.

 

 

 

 

Group 2_Teamwork_Mar 29_TouchDesigner, AE and MadMapper

The content of this blog consists of the work of  Jin and Yuan.

______Jin______

There are two aspects I would love to talk about in this week’s blog. One is the space selection for our projection and installation, the other is effect enrichment.

During the past two weeks, we kept testing studio spaces and rooms to find a place where can achieve effects we want (sufficient projection distance and shading).

First we tested at E15A and E15B at ECA main building. Since the size of the room, it is hard for us to make the frame project fully on the wall. But in the positive aspect, they are dark enough and able to make the sound fill of the whole room.

We used TouchDesigner to make effects of colorful ripples. We found that when we place a collage created by PVC piece and laser paper or change the focus of projector to blur the picture, the final effect would be better combined with real-time water ripples.

simple device

Then we tried a photographic studio at Evolution House, where we tried to use camera to capture the overlay effect of TD virtual and real-time ripples. And then we made the capture picture as the content of the human mask (to represent the person’s internal emotions/heart).

The effect did not meet our expectations.

Also, when we projected the content of TouchDesigner, the software border cannot be hidden and it influences the audience’s experiences.

Therefore, I want to use Madmapper to control the frame size and shape the overlay effects.

First, I want to create mask in Madmapper, but it did not work. So through AE, I create a mask at the position of heart, which follows the movement of the person. Now the layer below can be seen through the mask.

I pre-recorded the TD ripples to test the effect and that went well. So I managed to make it a live input. I tried NDI camera to capture screen, but it didn’t work.

Then I found TouchDesigner has similar mapping function of Madmapper, so I tried the kantanMapper, but it has the same question that the full-screen function cannot work.

After that, I used syphon to connect TD and Madmapper. 

Then I tried to use the corner to show the inner world and external appearance.

—–yuan——

After these two weeks of constant adjustments and modifications, a version has now been formed. In terms of sound design, my initial idea was to make ambient music, but after testing it, I found that the sound was smooth and did not highlight the rhythm of the characters on screen。

屏幕录制2023-03-30 01.44.32

so I added sound effects to the design. I used four samples as the ambient background sound. I used four samples for the ambient soundtrack, which were some of the water and ambient sounds we recorded outside last week, and then three dotted tones, using footsteps and water drops to make a soundscape. Also to match the image you need to take into account the rhythm, beat, pitch, timbre, mood and theme.

In our work, we show three sections of people walking, running and galloping to map the inner musical combination of the characters. Considering tha the movement of the person walking, running and galloping has a certain rhythm to it, matching the footsteps of the walk to the rhythm of the drums. Ambient sound effects are used to enhance the music. More relevant to the theme.

Combine Touch Designer’s audio visualization with the device’s water ripple:

In our tests we used the Touch Designer’s to pick up the audio from the max to make the water drops change. To create an effect that matches the rhythm and intensity of the audio.

Group 2_Teamwork_Material Test & Equipment

The content of this blog consists of the work of Jaela and Yuan.

Jaela and Yuan

With the feedback received last week, tests were carried out this week with different materials and different models of sound.

Vibration Test

The first sound vibration test was carried out with the Subwoofer.

 

Test 1: We glued the pvc sheets together to form a square container. A suitable amount of water was poured in for the vibration test. The water only slightly produced some vibrations.

Reflection: The container was too thick and heavy for the vibrations of the sound to travel up and produce vibrations easily。

 

Test 2:A test using a plastic disc to produce vibrations. The water waves were very small and the overall effect was still not good.

Reflection: The container may still be too thick and heavy and needs to be replaced with a lighter container.

 

Test 3: A very thin plastic cup was used for the vibration test. The vibration was very strong and the water waves were obvious.

Reflection: The material of the container needs to be very thin and light so that the vibration will be strong.

Test 4: Sound vibration test with Subwoofer and Genelec-8040-speaker respectively. Using the transparent plastic plate, the vibrations are strong and the water waves are large. But splashes of water may affect the projection effect.

Reflection: The amount of water needs to be controlled, too much will diminish the vibrations, too little will produce a lot of splashing water droplets.

Test 5:Tested with a plastic bag, the vibration effect is good, but the material is too soft and deforms when water is poured in.

Reflection: The material is also too soft and may affect the projection effect. The choice of material is important in order not to affect the projection effect.

Original plan

The speaker is placed flat under a table with a container on top of it, on the diaphragm of the speaker, and water drops are placed in the container so that the drops create ripples through the sonic Hertzian vibrations of the music. We will take photographs of the water’s shadow and light and record some sounds. These photographs and sounds will be learned by the AI, such as Mubert-text-to-music, disco diffusion, and clip interrogator, and then the AI will produce some musical compositions. Before each stage begins, we invite the audience to pick a piece of music from the three sections we provide to influence the ripples.

Modified programme

We had a meeting to discuss our project. The original plan was to have three stages of music, a lot of pieces, but now we want to cut out the extra pieces,we can do two or three different kind of concepts and changes, Locations that kind of reflect different aspects of the journey of life right. The presentation of the movement of the characters in the picture is changed through different musical rhythms. The musical rhythm of a person walking can be steady and even. The musical rhythm of a runner should be faster than that of a walker and can be performed with a faster tempo. The musical rhythm of a fall is usually more chaotic and can be expressed by using irregular beats or by using some techniques such as staccato and pauses in the music. Life is like a long run, and we need to run persistently to achieve success. In the process of running, we may experience various difficulties and challenges, but as long as we always persist in our belief of moving forward, we will eventually reach the end of success.

 

we can tie into the distance sensor and use the distance sensor as a kind of responsive tool as well for the music and turn that up and down or maybe how proximity as away ,and Music .we initially intended that we could use artificial intelligence to generate audio. But then the opportunity to create dynamic, responsive work would be lost. So we would use max. and we wanted the end result to be, like

https://www.bilibili.com/video/BV1Si4y197Tx/?spm_id_from=333.337.search-card.all.click&vd_source=43a1873fafb51f0936b53c75c77f14f3

 Installation Reflection.

 The gap between the stereo and the container can only hold small bulbs. The effect of putting a small bulb under the container to cast is not very obvious. Perhaps we could make use of the water wave footage that was recorded in advance. By projecting this footage to the ai, the scene could be projected with some of the patterns generated by the ai. Two walls could be used, one projecting the projection of the installation and the other projecting the ai generated effect. It might be more interesting for the audience to experience two different effects at the same time by touching or sensing to make the projection and the music change.

 

Recording equipment

 

  • l material selection
  • l High sample rate
  • l High audio quality

Recording Programme A.

Sound is a very important form of expression in a person’s life, and it can record a person’s growth from infancy to old age. It can be a valuable way of recording, as well as reminding people of past events and reflecting the preciousness and profundity of life.

  1. Infancy: the sound of a baby crying, lullabies in a cot, parents kissing, the sound of a warm family atmosphere.
  2. Adolescence: the sound of classes in school, the sound of activities on campus, the sound of students communicating, the sound of themselves at play, the sound of television or films.
  3. Middle age: ambient sounds at work, conversations in the home, children playing, sounds of family activities, the sound of music when you are relaxing and resting.
  4. Old age: sounds of family life, the company of family members, walking in the street, music while relaxing, sounds of natural landscapes.

 

Site reference.

Schools; meadows; sounds of people walking in the street

 

Recording Programme B:

Record the sounds of the natural environment at different times of the day or in different weather conditions, such as the sounds of nature, water currents, the sound of the wind on the beach, etc. These natural sounds can be recorded at different stages of life and in different situations, and can be poured into the max to create music that resonates with the audience.

 

Reflection

I bought a separate amplifier unit, soldered and assembled it, and ran a new test on Sunday as the previous test had not worked well.

 

The locations chosen for this recording were the Royal Botanic Gardens in Edinburgh and portobrllo beach, where the ambient sound was recorded. We capture the ambient sound as a basis for the music and edit it in max to create an ambient music. max is obviously the most important direction we should work on.

 

The microphone of choice is the Sennheiser – MKH60 – Shotgun – Hypercardioid, as hypercardioid microphones are often used when you need to pick up sound in noisy environments to accentuate your voice while reducing the effect of ambient noise on the recording. Ideal for recording ambient sound. Using a portable digital recorder, we chose a location close to a stream where there was not too much background noise. After continually adjusting the direction and height of the microphone, we found a location with better sound reception to better capture the sound of the water flow. The recording was edited and adjusted using protools.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Group 2_Material Preparation 1

After the group discussion, we had a preliminary distribution of work. My job was the preparation and purchase of materials.

Lights

First I tried a mobile phone light source as a light for the water ripple reflection and determined that a point light source was the best light for reflecting the ripples.

I then tried a larger yellow spherical light source and found that this light source, because of its particular construction and colour, reflected colourful light through the object on the wall.

I tried other light sources of different sizes, such as a circular torch, a long strip of light, and a small torch.

But none of the results obtained were as good as the mobile phone light source and the yellow spherical light source. I presume this is related to the intensity and size of the light source.

So, after a discussion with the rest of the team, I decided to go for a mobile phone light and a yellow sphere light. The final choice depends on the final result.

Water Tank

Considering the light transmission of the water tank, I preferred to use glass as the material of the water tank. But as can be seen in Figures 1 and 2, whether it is colourless or tinted glass, it is difficult to reflect the ripples of the water visibly on the wall as the glass is too thick and has a strong light reflection of its own. So I came up with the idea of a transparent PVC material.

First, I purchased 110mm*110mm*110mm pieces of clear PVC and then glued them together with a glue gun to form a square water tank. Through testing, I found that the transparent PVC material had a good weight and light transmission, which was very much in line with our project requirements.

However, in subsequent tests I found that the tank was too small, resulting in a small projection area on the wall and a noticeable black edge. I, therefore, intend to re-purchase the clear PVC.

Laser Paper

In comparing the projection of the PVC water tank with a mobile phone light source and a yellow spherical light source, we have tentatively decided on a mobile phone light source. In order to achieve the light reflection in our design concept, we wanted to use laser paper to achieve this effect. This means that the white light source is reflected through the laser paper, causing the light to reflect in different colours on the wall.

However, practical tests showed that the projection of light on the wall through the single laser paper was not obvious.

Transparent PVC SheetS with Pigments

As the projection of the single laser paper on the wall was not obvious, I tried cutting the laser paper and pasting it in the form of a collage on a transparent PVC sheet. But the projection was also mediocre.

Then I tried to colour the transparent PVC sheet with gouache paint so that the light would be projected on the wall through the coloured translucent PVC sheet. However, the projection was still not good.

Therefore, I am trying to find other ways to make the light appear colourful on the wall.

Drip Device

We were going to make our own drip device but I suggested that we could just buy medical drip props which would give us better control of the drip rate. As medical drip props are not sold in the UK, not even for plants. I, therefore, decided to purchase them from China and have them couriered to Edinburgh. As the time between purchase and receipt was greater than two weeks and returns were not possible, I opted to purchase two different drip props for plants.

Arduino

We expect the Arduino to control the start of the drip unit, the running of the unit and the projection of the projector.

 

Group 2_Teamwork_Analysis and Reflection of other Installation Projects with Arduino

The blog content is by Rudan in collaboration with Jin.

Blog Background:

According to Philly's feedback about our submission one, we tend to reflect our initial ideas and concepts and analyze other installation projects, in order to have a deeper understanding of wider context.

In addition, after discussion, our group is divided into two sub groups for further research and clear division of labor. Rudan and Jin are responsible for more detailed Arduino coding and installation creating process. Jalea and Yuan are in charge of music generation with MAX. In this blog, I (Jin) and Rudan would make a reflection on our submission one based on our research on other installations with Arduino and lights.

Rudan:

Project One: Plant Sensory Visualization

【Notes: On the rational integration of installation design and theme】

https://www.bilibili.com/video/BV1LL4y1T7oG/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

Case concept introduction:

Plants are often overlooked, but they live in symbiosis with us. They collect invisible information about nature and express it through their own state – the color of their leaves is richly colored, their form is uplifted or drooping – and they are the most important part of our lives.

This project aims to explore the possibilities of human-plant interaction by ‘touching’ plants through art installations and ‘observing’ their data – light, water, and emotion. This will help people to understand what plants know and feel, and to deepen their connection with them.

【Notes: There is a certain similarity to our concept. The design uses the Arduino and the installation to show the life of a plant, and our design uses water to show the life of a person. Through this design, I thought about the possibility of using devices to complement the concept of ‘human life’.】

Studyable component:
  • The way in which touch sensors and humidity sensors pick up data and import it into the device (data transfer from the device via Arduino only).
  • The way in which the plant state is represented figuratively.
  • The way in which the device interacts with people.
Arduino:

The installation is divided into two parts: the moss and the device (blue optical fiber). The moisture sensor is used to obtain soil moisture data, which is fed into the Arduino, and the blue light dot on the optical fiber increases. In this way, the moisture of the soil is visualized.

By means of a touch sensor, the red light spots on the optical fibers increase when a person touches the moss.

【Notes: The installation visualizes the state of the plant in a fiber-optic variation. In our design, the concept of the ‘human life cycle’ was intended to be presented through the changing projection of water on the wall, but this did not seem to be a direct way of making the viewer appreciate our intentions. We thought about the possibility of using some sensors to make the projection of the water change and at the same time make the wall appear to represent the stages of a person’s life (child, middle-aged, elderly).】

Project Two: Mirror World

【Notes: On the use of the sense of fragmentation in the expression of meaning.】

https://www.bilibili.com/video/BV1q14y1h74J/?spm_id_from=333.788.recommend_more_video.0&vd_source=6fa38bbeeec457ffe4bd5ac5a5e3fb8e

Case concept introduction:

The materials are mirrors, acrylic panels, acrylic columns, UV adhesive, and the model is purely handmade. A visual art display combined with the materials.

【Notes: The sound and nature of the material can be used wisely to achieve unexpected visual effects.】

Studyable component:
  • Visual effects.
  • Sound effects.

【Notes: Consider whether the sounds and effects of the material can be used to further highlight the changing ‘stages of life’.】

– Thinking about the development –
  • Using the principle of pin-hole image, the projection of ‘a life of a human’ on the wall will change.

https://byjus.com/question-answer/draw-a-labelled-diagram-to-show-the-formation-of-an-image-of-a-tree-by/

For example, in our design we use wall projections to present the three stages of a person’s life, i.e. in the first stage, the projection of a child appears on the wall and the colorful ripples produced by the water surface are reflected in the child’s projection; in the second stage, the projection switches to a middle-aged person and the colorful ripples reflected in the middle-aged person’s projection change; in the third stage, the projection switches to an elderly person and the ripples change with the music.

(This image was drawn by Rudan Zheng)

  • Transformation of pictures in small-aperture imaging using the kaleidoscope principle, achieved with a mechanical gear mechanism.

Conception: the weight of the water is sensed by a pressure sensor and the rotation of the gear is controlled by the change in weight (the fall of the steel ball). The picture of the small hole imaged is bound to the gear and changes when the mechanical gear undergoes rotation. Case reference:

https://www.bilibili.com/video/BV1oo4y1677q/?spm_id_from=333.1007.tianma.4-4-14.click&vd_source=6fa38bbeeec457ffe4bd5ac5a5e3fb8e

  • Combine fragments of highly reflective materials such as broken mirrors and glass with the reflection of light to make it more complex and achieve a more striking visual effect.
  • Consider incorporating the sound of breaking mirrors and glass into the soundtrack of the ‘middle age’ stage to convey the idea that life is not always easy.
– Arduino (distance sensor coding)-

CS:

Arduino:

Continue reading “Group 2_Teamwork_Analysis and Reflection of other Installation Projects with Arduino”

Process – Group 2 Submission 1

Process Group 2

List of group members:

Jin Qin (s2309515): Installation + Arduino coding + time control
Rudan Zheng (s2309043): Installation + Arduino coding + financial
Jaela Wang (s2417731): Video and editing + Installation + Equipments
Yuan Tian (s2453498): Music generation + Installation + pops

Initial Concept Generation

We confirmed our project keywords: Sound and AI. After a few days of brainstorming, we came up with some interesting preliminary ideas as follows:

  1. Sounds of the season: capturing the sounds of the seasons and synthesizing them into a piece of music with AI
  2. The world of color blindness: If I were a color blind person, could I experience the colorful world through sound
  3. Musical Puzzles: exploring whether someone who doesn’t know music can make a piece of music, through a collage (similar to a material puzzle, then synthesized with ai music)
  4. Musical visualization device: embodied music
  5. Vibrations of music (amplified) – water/vibrations of lines/line drawings/other media
  6. Music and Time: rhythm and the different frequencies of time, exploring whether music can change one’s perception of time
  7. A world of astigmatism: what would the world look like if I blurred your eyes (Using AI as an example, blur the image with hairy glass or water and use ai for analysis)

Among those ideas, we prefer the element of water, namely the fifth idea, and then we discussed the details and its way of realization.

Our initial scheme was:

A drop of water evaporates for 30 minutes. During the process, the vibration of sound will change the refraction of light, and display wonderful light and shadow exhibition. The process can be divided into three stages, similar to a person’s lifetime. Also, the music will be separated into three steps to cooperate with the changes. At the same time, there will be a projector for casting various environments and animation to create a more immersive experience for the audience.

In terms of sound design, the music is selected to represent the trajectory of different periods in life, using the vibrations of the speaker’s diaphragm to make contact with the wooden board, allowing a drop of water to resonate with the sound, which is perceived visually through the amplitude of the water drop’s rippling vibrations. Over time, the water droplets slowly and unconsciously evaporate, allowing for an association between perception and imagination, engaging the senses, and bringing about an interactive experience of time and space.

We collected some reference pictures and tutorials, and then created a mood board.

Dissection of “Process”

However, after our clarification to Jules on Thursday in week 3, Jules pointed out that our discussion was limited in the practical aspects, without the dissection of the concept of “Process” and the inclusion of AI. Therefore, we carried out an analysis of the concept of “Process” in two dimensions: the first one is the dissection of project content and connotation, and the second one is the dissection of the design process.

Dissection of the Process of our project Content

We analyzed the “Process” based on our initial concept of water projection. The analogy is applied to explain the project objects and connotations.

The water (the project object) is equivalent to me (the analogy object).

The dripping speed of the waterdrop represents the speed of my growth.

The size of the water in the container represents the extent of my development.

The light expresses society.

The beam of light striking the water means the influence of culture on us.

The vibration of sounds or music represents the influence of our family/others’ evaluation of us.

The light and shadow of water projected on the wall represent my image in the eyes of others.

The flow of water from less to more to none in this device shows the period of my life from birth to the completion of my sentence.

Dissection of our design process

AI artists are playing a more significant role in the art and Design field. Meanwhile, Hidden dangers and controversy are ensuing, such as the unclear copyright, the substitutability of AI artists to human artists, and the artistry of AI works of art. Therefore, we would like to discuss some questions:

  1. What role does AI play from the artist’s design process to the final production?
  2. Whether AI can replace artists in design or not?
  3. If AI intervenes in most of the content during the design process, can the final work touch the audience?

Under such questions, we designed a working flow to test the competition between AI artists and human artists through two controlled experiments.

Human Artist AI Artist
First Stage Take a series of photos, and create an animation based on the photos The series of images is fed to AI, and the AI artist outputs continuous pictures for animation
Second Stage Create music based on the animation created in the first stage Generate music based on the animation video feeding to AI like Clip Interrogator
Third Stage Exhibit two final composition works, and let the audience choose their favourite work
Final Preference

We prefer the dissection of the project content after analysis and plan on the two different understandings. From our perspective, AI is regarded as a tool for helping human artists broaden their minds. A personal initiative of a human artist is the reason for the origin and existence of art. In this case, we focus on our project content with AI working as a tool to compensate for our shortcomings. In addition, our work is expected to review social phenomena with social meaning rather than discuss “meaning”.

Besides, combining installation creation with coding is more challenging for us and needs to be tested, improved, deleted, and modified for the long term. For us, the process of challenging and creating is meaningful, so we will keep recording the project creation process.

The specific plan

Fig. 1. Text Flow of Project Process

Fig. 2. Picture Flow of Project Process

The installation includes a distance sensor. Once the audience approaches the sensor, the speaker, the light, and the water-dropping system start running. The speed of water dropping changes according to different stages. Ripples appear, and the speaker’s vibration can influence the water’s morphology and dynamics. Ray thought the laser paper and water project had notable water changes on the wall. When the water is full of the container installation, it will be poured away from the container. The whole process can be divided into three stages, where music and water-dropping speed are continuously changing.

Fig. 3. Graph of Relationship of Time and Speed of water-dropping

The speaker is placed flat under a table with a container, on top of the speaker’s diaphragm, water drops are placed in the container so that the drops create ripples through the sonic Hertzian vibrations of the music. We will take photos of the shadows and lights of the water and record some sounds. Those photos and sounds will be learned by AI, such as Mubert-text-to-music, disco diffusion, and clip interrogator, and then AI will generate some pieces of music. Before each stage starts, we invite an audience to pick one piece of music from the three parts we provide to influence the ripples.

Materials we need

Water, Mirror, Camera, Spotlights, Laser Paper, Transparent Container, Straws, Distance Sensor, Arduino Motherboard, Water-dropping Installation, Room without window or with curtain, Speaker, Speaker Diaphragm

Time Schedule

Week 1 – lecture

Week 2 – brainstorming, group discussion

Week 3 – modification and improvement of the project according to suggestions of Jules and Philly

Week 4 – decision on detailed design, material preparation and space lease

Week 5 & 6 – project testing, sound test, AI learning, installation design

Week 7 – testing in room

Week 8 & 9 & 10 – video editing, sound editing, Arduino coding and testing

Week 11 & 12 – complete testing

Week 13 – modification

Week 14 – final composition, video editing

Reference List

【TouchDesignerTutorials|Noise Creative Spin BallLeapMotion Gesture interaction】

https://www.bilibili.com/video/BV1EG4y1g72Z/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

【Audio-visual Interactive – Aurora_】

https://www.bilibili.com/video/BV1d84y1k723/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

【Processing–Blowing interaction】

https://www.bilibili.com/video/BV1PE411k7bf/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

【Plant sensory visualisation/A sketchy interactive installation】

https://www.bilibili.com/video/BV1LL4y1T7oG/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

【Interactive artwork AS IF】

https://www.bilibili.com/video/BV1hP4y1c7PN/?share_source=copy_web&vd_source=c0cd555c871b3d6c3923522ce3b0a1a8

【Simple Motion Visualisation –Simple motion visualisation can be done using Kinect】

https://www.bilibili.com/video/BV1Pd4y1o71B/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

【Touchdesigner Sound and picture interactive lines】

https://www.bilibili.com/video/BV1BV4y137kL/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

【 “Water” ambient light – Arduino design】

https://www.bilibili.com/video/BV18X4y1u7XP/?share_source=copy_web&vd_source=a8711564270b15c0c52431a25b613a14

 

 

Group 2_Personal Ideas

At the end of the first session, all the members of Process discussed and decided to work in two groups. I decided to form a group with Jin Qin, Yuan Tian and Jeala Wang.

Before the first group discussion, I proposed that we each come up with some options and then pick the most interesting one from our options during the group discussion and use that as the basis to start making our project.

I had discussed with Philly in class about the water, light and ripple design and I thought it was interesting and cool and the idea was approved by Philly. So I tried to use water, light and ripples as elements and came up with the following options:

  1. Sounds of the seasons: capturing the sounds of the seasons and synthesising them into a piece of music using artificial intelligence
  2. A colour-blind world: If I am colour-blind, can I experience a colourful world through sound
  3. Musical Puzzles: exploring whether people who don’t know music can make music through collage (similar to a material puzzle, then with an ai music synthesiser)
  4. Music visualisation installation: figurative music
    Vibrations of music (amplified) – water/vibrations of lines/line drawings/other media
  5. Music and Time: Rhythm and the different frequencies of time, exploring whether music can change one’s perception of time
  6. Astigmatic world: what would the world look like if I blurred your eyes (using ai as an example, blurring images with woolen glass or water and analyzing with ai)

References

– light art – light installations – reflections and shadows: Light art installation, light art, light installation (2023) Pinterest. Available at: https://www.pinterest.jp/pin/731483164496784888/ (Accessed: February 10, 2023).

Ellen Barratt – light work: Light art installation, projection installation, light installation (2023) Pinterest. Available at: https://www.pinterest.jp/pin/731483164496686680/ (Accessed: February 10, 2023).

Momento wonderglass (2023) Pinterest. Available at: https://www.pinterest.jp/pin/731483164496784817/ (Accessed: February 10, 2023).

Pin On Water (2023) Pinterest. Available at: https://www.pinterest.jp/pin/731483164496784814/ (Accessed: February 10, 2023).

‘under the barbers’ shop’ by Ellen Barratt – 2017, London – Interactive Light Installation: Light Art Installation, light installation, artistic installation (2023) Pinterest. Available at: https://www.pinterest.jp/pin/731483164496686762/ (Accessed: February 10, 2023).

css.php

Report this page

To report inappropriate content on this page, please use the form below. Upon receiving your report, we will be in touch as per the Take Down Policy of the service.

Please note that personal data collected through this form is used and stored for the purposes of processing this report and communication with you.

If you are unable to report a concern about content via this form please contact the Service Owner.

Please enter an email address you wish to be contacted on. Please describe the unacceptable content in sufficient detail to allow us to locate it, and why you consider it to be unacceptable.
By submitting this report, you accept that it is accurate and that fraudulent or nuisance complaints may result in action by the University.

  Cancel