Any views expressed within media held on this service are those of the contributors, should not be taken as approved or endorsed by the University, and do not necessarily reflect the views of the University in respect of any particular issue.

David Ivo Galego – Final Toughts

After roughly two months and a half, what first became a set of ideas, discussions and various points of view, questions have turned into answers and a “Place” was created to be presented on the 7th of April 2022 in the Atrium Room of Allison House. On this day, Echoes&Absences was finally showcased to everyone, and with it came a lot of reflections, room for improvement and concluding thoughts.

The large attendance achieved was initially desired, as the space was set out to be shared by a minor to reasonably large group, and the exhibition layout was designed to be discovered collectively. However, the celebratory mood among us developers and the audience may have hurt the sonic domain of the project since its soundscape was often easily masked by the expected sound of visitors chatting. Two thoughts arise from this: on the technical side, this could be perhaps resolved in a space with some second room layout that physically provided a more clear distinction between the exhibition/welcome hub and the actual immersive experience, and perhaps some acoustic isolation; However, when thinking on the exhibition as a “Place” of its own, these sonic interactions between people are an essential aspect to the soundscape, as the place becomes itself furthermore once people are also part of it.

The exhibition’s interactive aspect also seemed desirable since this “on at a time” control surface appeared busy at all times and wildly explored by the individual. While observing the users’ behavioural patterns, some interesting improvement points came up. A wooden plank was given to users when interacting with the interface, with the sole purpose of better ultrasonic detection from the distance sensor; however, users would very commonly tilt, flip and explore the position of this plank instead exclusively of their own. Such a natural reaction led to re-thing a solution for future exhibitions, where instead of placing the Arduino system in a fixed position facing the user, put it on this plank. This solution would allow us to explore accelerometer and gyroscopic data on the Arduino, and if given walls for projection instead of screens, more surface and distance range values to explore.

One last aspect seemed worthy of significant improvements. The sonic sculpture of this soundscape initially starts from recording the soundscape of the “News Steps” and then re-synthesised through the sonification of relevant data recorded on this sight. Until this point, the project had achieved a vital full circle of re-synthesis: all sonic outcomes were products of re-shaping the natural foundations of the New Steps. When it came to the nature of the interactive audio, even though spectrally fitting, this did not follow the same principle, which on the conceptual level breaks some of the re-synthesis value and the overall project. One easy way to improve this is to use sonic instances recorded on the sight where it all begins, such as stepping sounds, conversations and other relevant interactions. Another would be using the sensor’s data to trigger abrupt parameter changes on the Max/MSP project, re-synthesising the soundscape.

Overall, this project has allowed me to learn and explore the relationship between a location, its relation with time, and its points of contact with human perception, through methods of deconstruction and reconstruction. Breaking down and questioning the meaning of such intricate concepts of day-to-day life has allowed me to expand the notions of where reality starts and how we intend to perceive it to what my current notion seems limitless and never-ending.

I now acknowledge the tremendous efforts of my colleagues and my immense fortune of having had the opportunity to work and learn from such an incredible bunch. It has been my biggest of pleasures.

Until the next project,
David Ivo Galego

Personal Reflection – Yuxuan

First of all, I feel very fortunate to have taken the DMSP course and the Place theme this semester, which has been an unforgettable journey for me. Not only have I learned how to use LiDAR and TouchDesigner, but I have also worked with exceptional teammates to create an impressive project.

In terms of the final exhibition, although we achieved certain results, there are still many areas that can be improved upon. Firstly, the venue could be improved to create a more immersive environment, such as a curved screen that can cover not only the surrounding area but also above and below the audience, creating a stronger sense of immersion. Additionally, using edgeless LED screens or other display technologies can enhance the display effect, and a larger sound system can be employed to improve the audio experience. Additionally, to address the issue of conflict between the ultrasonic sensor and Kinect during the exhibition, we can consider using physical buttons or devices as an alternative means of interaction.

I am very grateful to my excellent team members. Firstly, I want to thank Allison and Yijun for working with me on the TouchDesigner design. We started from scratch and learned and explored together. Without them, it would have been difficult for me to learn so much. I also want to thank Molly and Dani for their efforts in setting up the exhibition and video rendering. They arranged everything perfectly on the day of the exhibition, which gave us enough time to solve any problems we encountered. Finally, thanks to David, Chenyu, Xiaoqing, and Yuanguang for their efforts in the sound design team, designing such a perfect immersive sound experience. In addition, I would also like to express my gratitude to our mentor Asad, who led us to explore and learn about LiDAR, an interesting tool that I believe I will use again in future projects. Thanks all for giving me an unforgettable team collaboration experience.

 

Yuxuan Guo

Touchdesigner visual part 2 – Thresh node

Based on B2BK (20223) tutorial video, I learned about the knowledge of the thresh node. Through the thresh node, we can process a portion of the particles. I connected it to a constant node and adjusted the green and blue values in the constant node’s RGB to 0. This allows us to manipulate the particles that belong to the red portion. As shown in Figures 1 and 2 and 3, I attempted to cut this staircase into two parts.

Figure 1                                         Figure 2

Figure 3

However, when I tried to manipulate parts of the image other than the red section, such as the green or blue sections, the changes were not noticeable. Therefore, we abandoned the use of this node.

Reference

B2BK (2023). Touchdesigner Tutorial – Advanced Pointclouds Manipulation. [online] www.youtube.com. Available at: https://www.youtube.com/watch?v=dF0sj_R7DJY&t=153s [Accessed 26 Apr. 2023].

If you’re reading this in order, please proceed to the next post: ‘Touchdesigner visual part3 – color and photographic composition’.

Yijun Zhou

 

 

Approach to the Brief

We depart from J.G Ballads story, The Sound Sweep, where the author writes “The ‘place’ of strange echoes and festering silences, overhung with a gloomy miasma of a million compacted sounds, it remained remote and haunted, the graveyard of countless private babels”. 

As the brief mentions, “It is in the hushed soundscape, in the inaudible where a place manifests.”. We extended from this by delving into the concept of how the sounds of a liminal non-place can be altered, morphed and warped by its physical counterpart. 

The project was said to utilise remote sensing and design informatics to enhance perception and broaden auditory experiences, resulting in the creation of detailed spatial datasets of local, site-specific environments throughout Edinburgh, Scotland. These datasets uncover and stimulate the spatial, temporal, and cultural characteristics of each location.

We challenged the brief on these aspects by taking the data sets and creating an interactive element that gives the user the power to create their own unique interpretation of the place. whist simultaneously conducting their own symphony of temporal sound. 

Through theoretical research, we explore what it means to quantify the concepts of Immersion and Presence. Undertaking a more detailed examination of Place and Non-Place, in addition to exploring possibilities of a digital exhibition.

Personal Reflection – Zhu Yuanguang

My experience in this Place group at DMSP was very rewarding and as I do not have a course in Max myself, I may not have been able to do much more practical work in Max-based sound design. Seeing the hard work of the group members, I did all the prep work I could (including equipment handling, field recording, audio and video recording of the workshop, etc.) and took an active role in the pre-planning and design of the sound installation on a live site.

In practice, we encountered a number of problems during the booking process, such as equipment being borrowed at short notice, and similar situations where equipments were not in the Music Store despite being booked in advance. I would like to thank the sound crew for their patience, encouragement and help, and because of them, all the audio equipments have been solved in a better way. Also, due to the large amount of equipments, the sound team members helped me a lot both during the testing phase and the official performance phase to make sure that the live sound installation was done efficiently.

I believe that with better support, the live sound installations for our project would be more logical and efficient, and would provide a better sound environment for the audience to experience.

Finally, I would like to thank all the members of the Place team and the tutors and students who supported us. The results and achievements of this project were not only the efforts of each individual, but also the result of the collaboration of all the people who contributed to the project. Thanks again.

Exhibition Day – Yijun

What I did

1. Debugging interactive devices and adjusting the range of detection values for the devices.

2. Connect Max to TouchDesigner and adjust the corresponding value ranges (the value range of sound and the parameter value range of TD are not consistent).

3. Adjust the visual artwork and ensure it is properly projected onto the screen.

4. Introduce the exhibition to the visitors who come and encourage them to try our installations.

5. Interviewing the audience and asking them about their feedback and suggestions regarding the exhibition.

6. Record interview videos

Asking the audience for their feedback and suggestions helps us better understand their needs and reactions, and based on this feedback, we can improve and optimize the direction of the exhibition. It also promotes communication and interaction between us and the audience, allowing them to have a better exhibition experience. This can also make the audience feel that their opinions and suggestions are valued and respected, and they are more willing to understand the concept and purpose of the project.

Challenges Encountered

There were some miscommunications in our previous discussions, which resulted in slight differences in the triggering settings between the sound and visual components. This caused the sound and image to be out of sync. When we attempted to fix the settings, we encountered some bugs in our code, but fortunately, we were able to resolve them in the end. Additionally, the computer we were using had a low configuration, which led to frequent malfunctions in our visual files, such as unstable and delayed detection results for the Kinect and sensors in TouchDesigner. The detection range of the Kinect and ultrasonic sensors also conflicted, and as most of our sound effects relied on the triggering of the ultrasonic sensors, we had no choice but to abandon the Kinect component.

Lessons Learned and Team Collaboration

The most profound lesson learned from this exhibition is that it is essential to conduct a comprehensive exhibition test before the final presentation, just like a rehearsal before a concert. There were too many unforeseen accidents, and advance testing can give us a rough mental expectation of the final presentation effect and prepare a plan B to deal with unexpected situations. Full communication within the team is also crucial. It is necessary to ensure that everyone receives consistent information to prevent a disastrous situation caused by information gap.

Yijun Zhou

Exhibition Day – Xiaoqing

 

What I did

1. arrive early before the start of the show to assist in checking and organising the sound equipment required for the show
2. Assist in setting up the surround sound system on site, installing and checking the sound system equipment
3. assist in testing the sound and volume components of the sound system
4. assist in measuring and accurately adjusting the actual step distance between the observer and the Arduino sensor
5. participate in external demonstration videos of connected equipment
6. Present the sound system structure to the audience during the demonstration and record answers to relevant questions
7. Prepare relevant professional questions and interview backstage observers in real time
8. Check and store the equipment after the performance and restore the scene

 

Challenges

In our installation, after testing and comparing, we chose to use a smooth iron plate as a prop in the observer’s hand to interact with the sensors. However, based on our observations, the transient response of this method was not as agile and fast as we would have liked during our testing. The reason for this could be due to the fact that the sensor response speed was delayed and accumulated throughout the display, thus causing our system settings to interfere with each other.

Secondly, some of the interactive trigger sounds were not immediately perceived by the observer throughout the presentation due to the grainy background sounds, which told me that I should have tested all the live sounds beforehand and adjusted their loudness and dynamics accurately so that all the sounds would blend into the installation sound system as much as possible, but still give the observer a sense of the trigger dynamics.

When doing the live space architecture, even after replacing multiple HDMI cables and connection inputs, the display would not play the display video until we replaced the computer.

Lessons

Despite the time we had anticipated, the number of problems that arose on site was a major factor that forced us to delay the preparation process. But when faced with these unexpected problems, calmly resolving them and having a back-up plan was the only way to help us get out of the situation. Behind the presentation of the project on this night was the entire design, refinement, debate and action of our team and the advice and help I received from my team members was the greatest asset I took away from the project.

Personal reflection – Yijun

I think the ‘place’ team is an amazing group!! It has given me confidence in teamwork projects, and the overall presentation of the project is impressive. It is definitely not a project that one person could complete in just two months. However, nothing is perfect, and there are still many areas that need improvement.

The biggest issue was the detection problem with the Kinect and Arduino sensors. As we mentioned in our blog, we ultimately did not use the Kinect part of the project because its detection range conflicted with that of the ultrasonic sensors. However, this made our interactive part somewhat monotonous because we only had the options of moving forward and backward, and triggering scene transitions. This weakened the immersive atmosphere. Additionally, we spent a lot of effort exploring different effects with the Kinect part, and not being able to present them was a great pity. Moreover, the ultrasonic sensor detection was not sensitive, and it was affected by clothing materials and lighting. We had to ask the audience to hold a heavy blackboard in front of their chests to trigger the effect, and it wasn’t always effective. One possible solution is that we could give up ultrasonic sensors and switch to coordinate-detecting sensors. Without considering technical and equipment limitations, if we could set up the entire exhibition site as a three-dimensional coordinate system, where the audience can trigger different scene effects and sounds in different areas, I think that would be very cool. Additionally, if the Kinect could be modified to capture the silhouette of a person and interact with the point cloud image, I think it could enhance the immersive experience.

Another issue is related to the venue and equipment. The size of the screens on both sides is not consistent, which affects the overall visual appeal of the exhibition. If we could use large LED electronic displays, the exhibition would be more refined. Additionally, our sensors were exposed, and perhaps we could create a prop that fits the concept to wrap  it up and create a more immersive environment.

In this team project, I deeply realize the importance of teamwork and the role of sound design in interactive media projects. Everyone is like a part of a machine, efficiently completing their own work. The presentation of this exhibition cannot be achieved without the efforts of Molly and Danni. They rented the venue, printed the models, created animations, posters, and postcards. They made this project finally presented to the audience in the form of a real exhibition. In addition, they actively communicated with the teacher, allowing us to receive feedback in a timely manner and improve the project. Also, this is the first time I have collaborated with classmates in sound design to complete a project. They demonstrated outstanding ideas and professional skills, allowing me to truly experience how sound enhances visual effects, creates atmosphere and emotions, and allows the audience to experience and feel the work more deeply. David’s professionalism and maturity have always effectively guided the team, and Xiaoqing and Chengyu have always actively followed up on the project and patiently solved the problem of how to combine the visual and sound parts. Yuanguang has also been communicating with David about the sound part. Allison and Yuxuan, as partners who completed the visual part together, have always patiently helped me solve the problems I encountered. Without them, I might have collapsed.

So happy!! Be a part of “place” team!!!

Yijun Zhou

 

Exhibition Day–Chenyu

What I did

  1. Arrive early to check out the equipment we book, and make sure all the things we need are here.
  2. Helping set up the 7.1 channel sound system
  3. Help to test out the sound system and the data transport from Max to Touch designer
  4. Help to show the concept video through my laptop
  5. After the start,  introduce our installations to the audience and answer their questions
  6. Interviewing some of the audience
  7. After the exhibition, return the equipment and restore the display inside the classroom

Challenges Encountered

This time we still meet the situation that although we have already booked the equipment on the bookit, since part of them have not returned to the store, we have to change part of them to build our system. Fortunately, we have a planB and are flexible enough to achieve the results we want. Another problem was I always failed to connect the screen with my computer, and finally found out it was because the hdmi port of the adapter was broken. I was very anxious and stressed at that time but finally we found the question out and solved it. The final one was the ultrasonic sensor didn’t worked very smooth with out the iron plate, and did not expect the possible impact of Kinect and ultrasonic sensor on each other .

What I learned from these challenges

  1. To have plan B is very important and useful, and at the same time, I should think out of the box, to solve the problems more flexible.
  2. The more urgent the situation is, the more calm I should be, carefully investigate the fundamental of the problem and find the way to solve it.
  3. It is not wise to disassemble each part completely independently, and we should also pay more attention to the possible influence between the different part. At the same time, more complete and simultaneous tests are very necessary.

Chenyu Li

css.php

Report this page

To report inappropriate content on this page, please use the form below. Upon receiving your report, we will be in touch as per the Take Down Policy of the service.

Please note that personal data collected through this form is used and stored for the purposes of processing this report and communication with you.

If you are unable to report a concern about content via this form please contact the Service Owner.

Please enter an email address you wish to be contacted on. Please describe the unacceptable content in sufficient detail to allow us to locate it, and why you consider it to be unacceptable.
By submitting this report, you accept that it is accurate and that fraudulent or nuisance complaints may result in action by the University.

  Cancel