Any views expressed within media held on this service are those of the contributors, should not be taken as approved or endorsed by the University, and do not necessarily reflect the views of the University in respect of any particular issue.

Final presentation video

We recorded a lot of videos during production and on the day of the final presentation. We organized the footage and edited it into the video below to better demonstrate our final success.

I use Adobe AE, Ar and some editing software to synthesize the video.

This is the video link:https://media.ed.ac.uk/media/The+long+farewell/1_2h5zctr4

Week9 Overall Contents Update

In the formal exhibition, there will be two computers to present different materials and the details of them are as follows.

Computer 1:

Play the video and music to help viewers experience the theme.

  • Display Video: 

Prologue (introduction) + Blur (including memory of faces and object scenes).

  • Continuously Background Music:

Play real-time in Ableton Live.

Computer 2:

Focus on Viewers’ real-time Interaction

  • Fade: 

Viewers should click a button on the laptop to take a photo first, then speak randomly to the microphone. The sound data and image are transmitted to the Max Patcher. The participant’s portrait will show on the screen, and some visual effects will appear on the screen when the participant is speaking.

Visual changes depend on the level of sound. When the visitor calls loudly, the image becomes relatively clear, while when the sound diminishes, the image becomes blurred. If the call disappears, the screen will gradually become blank.

We provide a poem as reading material to help participants get involved as follows:

By the boundless shores of Lethe, I seek your trace,Faces once clear, now blur in memory's breeze.Like dew in the morning sun, vanishing without a trace,Your smile, your gaze, with time, quietly flee from me.I reach out, trying to touch that fading shadow,But grasp only air, and a faint scent of melancholy.Alzheimer's, this silent thief,Steals our shared memories, bit by bit, from our world.There was a time, side by side, through seasons we trod,Now, I walk alone in this memory's barren land.Your name, I softly call, through thickening fogs,Your face, I struggle to recall, only to blur more with each attempt.Even if memories fade, love remains,In every dawn, every dusk.Alzheimer's may take away your memory,But it can never take away, our undying love within.

In twilight's gentle sway, amidst memories gray,Lie forgotten relics of a bygone day.A radio whispers melodies of yore,Its staticky voice echoing forevermore.Beside it, a television set, silent and still,Once a portal to dreams, now void of thrill.Images flicker, then fade into mist,Lost in the labyrinth of time's twist.A fan hums softly in the corner's embrace,Its blades spinning tales of a forgotten grace.Once a companion in sweltering heat,Now a silent sentinel in memory's retreat.A jar sits empty, its purpose unclear,Once filled with treasures now lost, my dear.Its glass walls hold echoes of laughter and tears,A vessel of stories from forgotten years.In the recesses of a mind now adrift,These objects linger, their memories swift.In their silent presence, a tale unfolds,Of lives once lived, now in shadows enfold.Oh, how time's cruel hand steals memories away,Leaving behind mere relics to sway.Yet in the heart's recesses, they shall forever gleam,Echoes of a life, like a forgotten dream.
  • Vanish: 

First, the participant’s movement path was captured using the same real-time camera and overlaid with the part of the video, allowing the participant’s face to blend in among the different faces generated by the AI, creating the illusion of being lost. Finally, the participant in the frame drifts away with particles and the frame goes black.

Week9 Plan for Exhibition

Place

28/03/2024 8:00 to 28/03/2024 22:00 Project Space Q25(Main Building)
01/04/2024 9:00 to 01/04/2024 12:00 Project Space J05 (Main Building)
03/04/2024 12:00 to 03/04/2024 17:00 Project Space J03 (Main Building)

Alternatives

28/03/2024 08:00 to 28/03/2024 22:00 Project Space E15A (Main Building)

30/03/2024 10:00 to 30/03/2024 22:00 Project Space E15A (Main Building)

01/04/2024 08:00 to 01/04/2024 22:00 Project Space E15A (Main Building)

Installation

1. Screen

J03 Screen

J05 Screen

2. Audio System

Ref: AV205662
Start: 27/03/2024 16:00
End: 04/04/2024 11:00

3. Other

1 HDMI Cable

2 Computer

1 Table

1 Chair

4. A Simple System FlowChart

Computer Presenting Contents

Week9 Overall Contents Update

Week8 New Version of A Generative Music

Music Demo in Week8

Instead of the original plan of making different music for each part, we now plan to make a generative music that requires no control and also randomly plays some melody fragments. I plan to do it in Ableton Live, which will play independently of the video with a separate computer during the exhibition. The screen recording video below shows the current progress of music creation. You can see that Melody Clip is played randomly.

These MIDI Clips are converted from the AI text to Music loop in the previous blog.
https://blogs.ed.ac.uk/dmsp-process24/2024/03/18/week8-find-inspiration-with-ai-music-tools/

In that track, I set up the Random Midi Effect as well so that each Clip can shift to different notes every time. Later I will add more instruments and implement more variations to the music.

Full Version Music Update in Week9

This version added many voice samples generated by Text To Speech tools and the text materials are as follows.

This version added many voice samples generated by TTS tools, and their corresponding text is shown below.

1. Why do you keep asking the same questions? I've explained it many times
2. Mom, your memory is really getting worse.
3. Where did you put the key? This is already the third time
4. Can you stay by yourself for a while
5. I am your daughter
6. Why don't you remember me again?
7. Dad, why did you put the medicine in the refrigerator again?
8. Didn't we make an agreement?
9. I really can't understand why you are always so stubborn
10. I've told you many times
11. I really don't have time to help you find things every day
12. Why do you always forget to turn off the lights? I have to come here every time
13. Why you can’t do simple things well?
14. I can't stand your chaos anymore and I need to leave this room
15. Don't bother me, I don't have time for you
16. 妈,你能自己回房间待一会吗
17. Maman, tu peux aller seule dans ta chambre pendant un moment ?
18. 何度も言いましたから、何度も聞かないでください
19. Realmente no puedo entender por qué siempre eres tan terco.
20. आपका ऐसा करना वाकई बेवकूफी है
21. Папа, это действительно глупо с твоей стороны.
22. 당신은 나에게 이것을 여러 번 말했습니다!
23. Das hast du mir schon oft gesagt!

Week9 Preparation for the exhibition

Camera stabiliser rental and test

Preview Tests

We ran two rehearsals in total, making some slight changes to the sound system as well as the environmental setup.

Thanks to Jules for lending us the free black cloth:)

 

For looped playback:

Given the differences in workload allocation and expertise, we utilized different software for execution. After numerous attempts, we successfully consolidated everything in Max. Currently, the second part of the video plays randomly selected clips, while the first, second, and third parts loop seamlessly. Only the real-time particles in the fourth part require manual switching between TouchDesigner and Max due to signal transmission between the two software. Although this sounds more like the software issue, as you suggested, recreating the same effect using components in TouchDesigner would allow for complete automated playback, achieving seamless transitions and looping. However, this might also imply that the efforts of team members could be in vain, leading to duplicated work.

 

Week8 Part 1-Animation rhythm adjustment and special effects

What I completed this week is:

1.Part One: An attempt to add multiple languages to the text dialogue

2.Part One Animation Rhythm Adjustment

3.Animation editing, synthesis and special effects

 

1.Part One: An attempt to add multiple languages to the text dialogue

The texts we used in the first part were all English dialogues, but I wanted to try adding other national languages, and after trying it, I found that the effect was pretty good. Later, combined with the sound generated by AI, it can create a more chaotic effect for the experiencer.

1. 妈,你能自己回房间待一会吗 ( Chinese)

2.Maman, tu peux aller seule dans ta chambre pendant un moment ?(French )

3.何度も言いましたから、何度も聞かないでください(Janpanese)

4.Realmente no puedo entender por qué siempre eres tan terco.(spanish)

5.आपका ऐसा करना वाकई बेवकूफी है (India)

6.Папа, это действительно глупо с твоей стороны.(Russia)

7.당신은 나에게 이것을 여러 번 말했습니다 (Korean)

8.Das hast du mir schon oft gesagt (German)

The following is the effect of putting various languages into the animation

 

I adjusted the overall rhythm of the animation part

The first part is a sentence that slowly flies out.

后面慢慢加速,文字堆满整个屏幕。我用adobe after effect增加了一些抖动,模糊等特效

The final complete effect (no sound version added)

Makeing process:

 

Week8 Find inspiration with AI music tools

AI Music Tool: Mubert | AI Music Generation

Idea
I’m working on developing a system for dynamically playing MIDI clips to provide a constantly evolving musical backdrop throughout our project. To build up a diverse library of MIDI clips, I’ve employed Mubert’s Text To Music tool. This tool allows me to generate numerous loop clips that may be thematically relevant to my project. From this pool, I carefully choose clips below that align with the atmosphere and tone of the existing parts of our project.
Generated Clips

Week7-Part2- Finding items with the point cloud particle effect presentation

Main idea:

To simulate the world in the patient’s mind when searching for an object through the first perspective

Week 7 Progress:
I tried to use C4D to model and texture different objects, then use Meshlab to attach point cloud particles to the model, and finally use Touchdesigner to create the effect of point cloud particles breaking and reconstructing.
I also tried different glitch effects and glitch sound effects to simulate the ambient sound of a patient looking for an object.

Follow-up ideas:
1. I would like to use AI to create a human voice to shout around this video in surround sound to make the patient look for these items and try to create an anxious sound.
2. I would also like to use Touchdesigner to construct a background of particle transformations of a real scene to be placed on the underside of these few objects to simulate a real space scene effect.

The effect reference:

https://www.bilibili.com/video/BV15h4y1p7rm/?spm_id_from=333.880.my_history.page.click&vd_source=442ca63363affa20fd2bbe58fc7ba11b

(0:34-0:38)

css.php

Report this page

To report inappropriate content on this page, please use the form below. Upon receiving your report, we will be in touch as per the Take Down Policy of the service.

Please note that personal data collected through this form is used and stored for the purposes of processing this report and communication with you.

If you are unable to report a concern about content via this form please contact the Service Owner.

Please enter an email address you wish to be contacted on. Please describe the unacceptable content in sufficient detail to allow us to locate it, and why you consider it to be unacceptable.
By submitting this report, you accept that it is accurate and that fraudulent or nuisance complaints may result in action by the University.

  Cancel