Overview: Quickly go through the visual part of the task allocation, talk about the plan for next week, and check if anyone has any questions.

1. Proposed Division of Work:

• Short to Mid-Term:

• Director (1)：Xinyi
  Visual Designer – Arduino（2）：Li Lyu、Can
  Visual Designer – TD（2）：Hefan、Yixuan
  Sound Design（2）：Roulin、Ashley

Later Stage: We will work together on the installation (I will first find some ideas and discuss them with everyone).

2. Upcoming Arrangements

• This week, we can conduct some experiments or collect inspirations. We will continue to advance after receiving feedback from the instructor next week.
• Internal meeting once a week (based on discussions about instructor feedback) to check individual progress.
• Blog: Simple documentation of thoughts and processes.（Under the Category of Sound Design/Visual Design/Meeting Notes）
• I will create a task progress table (for use next week)

Submission 1 (Feb 12th): Documentation + PDF Report (including visualized processes)  I will be responsible for this part.

3. Issues

• Material Purchase / Logistics & Reimbursement （Ask Tutor Next Week）
• Equipment Rental & Room Reservation  (Roulin)

Any Other……?

Jan 31, 2025

On January 28, we had a discussion with Jules, who approved our concept and suggested that we explore multiple aspects of breathing and reflect them through interactive installations. Additionally, since we were uncertain about the role of AI in our project, we revisited its necessity. In our initial idea, AI seemed to be deliberately inserted rather than an organic component of the concept. Our team also felt that AI might not be highly relevant to our project. Therefore, we asked Jules whether AI integration was essential, and his response was negative. Based on this feedback, we decided to temporarily remove AI from our plan and continued refining our discussion accordingly.

Overview

The meeting focused on finalizing the exhibition theme, discussing the form of the installation, possible audiovisual effects, interaction modes, and team responsibilities.

1. Theme

The exhibition is centered around healing, guiding visitors to observe and regulate their breathing rhythm through an interactive installation to achieve balance and ultimately a healing effect.

Background:
Breathing is essential to life, yet often overlooked in daily routines. After experiencing COVID-19, we have realized that free breathing is not always a given. The process of rediscovering breath itself can be a therapeutic experience. This project aims to explore the ‘process of breathing’ and guide people to reconnect with the present moment, finding balance and stability through perception.

2. Installation Form

• Real-Time Interactive Installation: The system will collect real-time audience data via sensors, generating dynamic visual and auditory effects. Projection screens or displays, along with speakers, will create an immersive environment.
• Installation Structure: Still under design.

Data Collection

• Sound Sensors: (Certain manageable data types can be selected)
  • Volume → Breath depth
  • Frequency → Breathing rate
  • Waveform features → Different breathing types (steady, rapid, irregular)
  • Duration → Breathing rhythm
  • Spectrum → Different breathing states (relaxed, tense)
• Temperature Sensors: Detecting temperature differences between inhalation (cooler) and exhalation (warmer).
• PPG Sensors (Unconfirmed):
  • Heart rate → Deep, slow, and rhythmic breathing can lower heart rate, promoting relaxation.

Data Processing & Presentation

• Data transmission via Arduino to TouchDesigner/Max for generating real-time visuals and sound effects.
• Breathing data will drive changes in sound and visual parameters.
  

  3. Audiovisual Design

  • Synchronized Visuals & Music for a more therapeutic sensory experience.
  • Visual Concepts: Centered around themes of healing, breathing, and life.
    • Nature-Inspired Elements: Tree growth, blooming flowers, water ripples…
    • Organic Forms: Artistic representations of lungs, noses, mouths, skin, and muscles.TD Visual Reference 1

      TD Visual Reference 2
      

      TD Visual Reference 3

  Visual Effects Example:

  • Steady Breathing:
    • Darker visuals with softer colors to enhance relaxation.
    • Smaller, slower-moving particles creating a tranquil atmosphere.
    • Water ripple diffusion slows down, giving a gentle flow effect.
    • Increased transparency of elements to enhance lightness.

  Sound Design Examples:

  • Calm Breathing: Soft, soothing sounds complement slow visual transitions.
  • Intense Breathing: Rhythmic, impactful sounds paired with dynamic visuals.
  • Music & Breathing Data Integration:
    • Fixed rhythm for a stable environment.
    • Real-time breathing data affecting specific sound effects (e.g., low-frequency resonance, echo variations).

  4. Interaction Design

  • Breathing Guidance: Using voice instructions, visual cues, and sound prompts.
  • Spatial Design: Layout, lighting, and projection setup.
  • Group Interaction Possibilities:
    • Synchronized Breathing: When multiple people breathe in sync, light pulses with the rhythm.
    • Asynchronous Breathing: Different breathing rhythms trigger varying colors or motion effects.

Jan 31, 2025

Our first meeting took place at ECA Café, where we gathered to exchange ideas and explore potential directions for our project.

Ideation on Miro Board

The central theme discussed was “The Process of Breathing.” This concept focuses on enhancing concentration by directing attention to one’s own breathing, aiming to achieve inner balance. It draws inspiration from meditation and is also applied in cognitive behavioral therapy.

One proposed idea is to utilize AI to process breathing data and generate artistic expressions based on it. Several reference projects were shared:

1. Resonance Room – A project where the aperture changes in response to the audience’s breathing, offering an intuitive way to observe and interact with one’s breath.
2. A live performance integrating human organs and plants – The interaction between the audience and projected visuals, along with atmospheric sound design, creates a captivating and immersive experience.

3.A multimedia installation using AI algorithms – This project generates intricate structures through AI and incorporates 3D printing techniques.

4. Melting Memories – An artwork that collects brainwave data and uses AI to create dynamic abstract visualizations, exploring the fluidity of memory and consciousness.

To bring this concept to life, several key steps were outlined:

• Data Collection: Gathering breathing-related data, where variations in frequency and depth could represent different emotional states.
• Data Processing with AI: Using machine learning models to transform the collected data into visual representations, a challenging but achievable task given the availability of online resources for model training.
• Possible Outputs: Various artistic expressions, including visual, auditory, and even tactile elements, could emerge from the processed breathing data.
• Exhibition Design: A structured exhibition space was envisioned, guiding audiences through different areas showcasing the outputs. The goal is to create a serene and immersive environment where visitors can engage with the breathing process through multiple sensory experiences.

This initial discussion laid the foundation for further exploration, with a focus on refining the technical approach and conceptual depth of the project.

 

Jan 31, 2025