Music

c 72
f 65
g# 68
C# 73
D# 75

The chords formed by these notes sound harmonious together. C, F, and G# form the chords of the C minor scale, while C# and D# form the chords of the C# major scale.

C and F: These two notes are typically considered to be natural, calm, and warm, suitable for creating relaxing music. G# and C#: These two notes are considered to be mysterious and enigmatic. C# and D# are often used to create a mysterious or fantastical ambiance. This  add some vitality and dynamism to my music. The combination of these notes can create a mysterious atmosphere.  The use of these notes also be to complement the visual elements which is plants of the project.

Overall, they can convey emotional colors and atmospheres related to the theme of interaction between plants and humans in my music.

 

Drum

Drums are often used in music to create a rhythmic foundation and drive the energy of a piece. In the context of my project, the drum is used to simulate the beating of a plant’s “heart” and to represent the pulsing energy of nature.

I have added a lot of resonance to the drum section, which can help create a more vibrant and dynamic sound, and also add a sense of spaciousness and depth to the overall mix.

I have written the following algorithm to adjust the rhythm of the drums.

if $i1 == 1 then $i1 else out2 $i1

Organ

Organs are known for their rich and powerful sound, which can evoke a sense of majesty or grandeur. The reason for using the organ is to create a mysterious and ethereal atmosphere in the music and to create a sense of  wonder in the listener.

Using the ioscbank~ object in Max is for achieving a multi-timbral effect in the organ section. This may make my organ sound more diverse and colorful, giving it more expressiveness.

 

Mallet

 

Mallet instruments have a bright and sparkling sound that can add a sense of playfulness or whimsy to music. In my project, the mallet could be used to represent the delicate and intricate beauty of plants and flowers and to create a sense of joy.

Adjusting the ADSR in real-time during performance can allow me to follow any irregular changes in the plant’s behavior, which can enhance the overall musical experience and make it more dynamic and responsive.

I used 6 mallets to create a fuller sound and overtones and the way I used could reducing computational load.

Noise:

I also add some noise. Noise is used to represent the unpredictable and uncontrollable aspects of nature.

SET UP

As shown in the diagram, the audio effects from the first part of the patchbay and the second part of the looking glass can be listened to using the headphones next to the device. Both are Bluetooth headphones connected to the computer’s audio that is hidden behind the stand. The audio from the first part is directly connected to TouchDesigner, and the audio from the second part is connected to Wwise. The third part has a microphone connected to TouchDesigner for visualization, allowing the effect to be changed based on the audience’s input.

 

Apr 27, 2023

In the initial stages of my project, I consulted with my teacher on how to simulate the sound of a flower opening. My teacher suggested using objects such as unfolded paper to create the sound. However, I found that using a full sheet of tissue paper produced too much noise. Instead, cutting the tissue paper into small pieces, roughly one square centimeter in size, resulted in a purer sound. Additionally, unfolding objects such as tissue paper can produce a lot of noise. To address this, I used small pieces of tissue paper and mimicked the motion of gently stroking the flower petals to create a more delicate sound. Throughout the process, I kept in mind the need to convey a sense of gentleness and delicacy in the sound.

Another approach I took was to use a porous sponge cloth to create a sound effect for one of the flowers. This worked well as the texture of the sponge matched the porous texture of the flower petals. During playback, the sound was transmitted via Bluetooth headphones connected to a nearby tree-shaped audio station. This allowed visitors to experience the delicate sounds of the flowers without interfering with the music playing throughout the exhibition space.

Apr 27, 2023

The first step in creating a flower is to generate a petal. The shape of a petal is not complex and has symmetry, so it can be seen as a geometric plane. In TouchDesigner, there are various ways to generate such a plane using a spline curve to create a contour and then using the Poly algorithm to create the plane.

To generate a spline curve, the Line SOP is used to create a curve with a desired number of segments. The curve is then created by modifying the coordinates of each point on the spline, so it is necessary to ensure that the initial spline has enough segments. The curve spline is generated using the geometry attributes value (Attribute) modification method in SOP, which can be achieved by using the Chop to SOP. In this case, the Pattern Chop is used to generate the curve spline as shown in the image.

https://docs.derivative.ca/Attribute

 

Next, the Copy SOP is used to make a symmetric copy of a single curve spline, creating a closed spline curve with a petal shape. To convert the closed spline curve into a plane, the PolyMatch SOP is used. This SOP can use various geometric surface calculation methods to convert the closed spline path into a plane, where the level of detail of the plane can be defined. Thus, the petal is formed.

The final step is to add some curvature to the rigid petal by using the Twist SOP, which gives it a more natural appearance. After completing these steps, the geometry allows us to reuse the geometry and modify its appearance programmatically, which is one of the key benefits of procedural modeling.

I need a reference data source for replication – the receptacle. In my assignment I used overlapped circle rings of various sizes (circle SOP) as my reference data for petal instantiation. The coordinate data of each geometry point (Points) on the circle is the position reference of the petal, and the normal data is the orientation reference of the petal. In addition, Scale (size) attribute values are defined and added to the circle to control the size of each layer of petals, as well as Color attribute values to control the color of the petals on each layer of the circle. When defining the basic circle, there is a problem that the normal direction at each point on the circle is not radiating like real petals, but all vertical. Here, I use Point SOP to redefine the direction of the normal to make the normal direction perpendicular to the tangent of each geometry point’s location, and the normal direction can be controlled later to control the opening and closing of the petals. I used the Point SOP to reorient the normals of the base circle so that they are perpendicular to the tangent at each point on the circle. This allowed me to control the opening and closing of the petals by manipulating the direction of the normals.

After completing the procedural modeling of the flower, we can start building a rendering pipeline for rendering the scene. To make the flower look less stiff and rigid, we can use the Noise SOP to affect the orientation of the petals, creating the effect of wind disturbance. Additionally, because we want the color of the flower to signify that it is a digital flower, it is not necessary to create a fully realistic effect. For the color of the petals, we use noise and disable its monochrome effect, resulting in a colored effect. Then we map it to the environment, which reflects directly onto the flower itself.

 

This project utilizes the custom-built component AudioAnalysis Pro. Attached below is the authorized AudioAnalysis file (compatible only with version 2022), which is more user-friendly and easy to connect with other components than the original version. It also fixes a bug in the software activation interface. This component has greatly helped in the development of my visualization project.

When adding audio to the visualization, you can use the AudiofileinCHOP to add a file or the AudioDevicelnCHOP component to input real-time microphone audio. For my project, I used a simple PBR material without any texture maps. I added a metallic sheen to the material to give it a more futuristic, high-tech feel.

I also created a wireframe material using the LineMAT component and adjusted some parameters. I used a Switch to toggle between the normal material and the wireframe material based on the music. I created the background using the BlurTOP component, using the simplex3D function of noise to adjust it.

Finally, I bound the specific effects of the AudioAnalysis component to my visuals through mapping and data normalization. For example, the kick is bound to the wireframe material and the rotation speed is increased when there is a kick in the music. I tested my project using low-frequency music, but the final effect will be adjusted based on the music used, which has a lot of high-frequency sounds. Oh, by the way, I added an oscilloscope which makes it easier to see the effect.

As you can see, I put a lot of effort and creativity into my visualization project. I  incorporated so many different elements, from the 3D modeling of the flower to the use of audio analysis to create dynamic visual effects. I really care about the feel of the project and I think it is a well-crafted and engaging piece of work.

Apr 26, 2023