Steps

• Connect the Leap Motion and the Looking Glass

 

• Install the Leap Motion SDK: Download and install the Leap Motion SDK, which will provide useful libraries and sample code.

• Install the Looking Glass Unity SDK: Download and install the Looking Glass Unity SDK, which includes the necessary tools and assets for developing Looking Glass applications in Unity.

• Set up the scene in Unity: Create a new scene in Unity and add a Looking Glass plane to the scene. Import 3D model into the scene and place it in front of the Looking Glass plane.

 

• Write the Leap Motion control code: Use the Leap Motion SDK to write a code that reads the Leap Motion hand gesture data and converts it into a control signal for the 3D model in Unity.

• Map the hand gestures to model controls: Map the Leap Motion hand gestures to control the 3D model’s rotation, translation, and scaling in Unity.

• Test and refine the control system: Test the control system with the Leap Motion and Looking Glass devices and make adjustments as necessary to improve the accuracy and responsiveness of the controls.

Apr 26, 2023

 

We wanted to connect the interactive device to a video player and audio, and after exploring this we found that we could use touch designer to connect the arduino to the video and audio and control the audio and video playback through the interactive device.

STEP

1.Connect the Arduino board and pressure sensor: Connect the pressure sensor to the Arduino board, and then connect the Arduino board to the computer.

 

2.Write an Arduino program: Use the Arduino development tool to write a program that reads data from the pressure sensor and transmits the data to the computer.

 

3.Install Serial DAT: In TouchDesigner, install the Serial DAT component, which can receive data sent by the Arduino board.

4.Configure Serial DAT: In TouchDesigner, configure the Serial DAT component to communicate with the Arduino board. The serial port and baud rate parameters need to be specified.

5.Create a trigger: Use the CHOP component in TouchDesigner to create a trigger that can receive data sent by the Serial DAT component and convert the data into a signal that can be used to control the speed of video playback.

6.Control the speed of video playback: Use the Movie File In component in TouchDesigner to import a video file, and use the trigger to control the speed of video playback based on the data received from the pressure sensor.

7.Connecting device

Reference

Apr 26, 2023