Interactive Movement Experience

2024-08-30 13:54 UTC gpt-4o Open in ChatGPT ↗

Rewrite this as a clear cohesive summary of an interactive experience:

A single user enters the interactive zone where their movements / gestures will be tracked by the camera(s).

They are facing the LED Screen and the camera(s). Facing away from any surrounding audience.

They are prompted to move, dance, pose , mimic, wave, jump, etc. (Perhaps the experience starts with a short ‘tour’ of some example movements/choreographies to give them ideas / inspiration, people may be unlikely to move in interesting ways without being prompted).

Some sort of cue to start the experience.

As they move they see a tracked avatar / skeleton / representation of their self and perhaps some fancy overlaid graphics recording their tracking data: Position/Coordinates (X, Y, Z), Velocity, Acceleration, Angular Velocity, Angular Acceleration, Jerk, Maximum Speed, Jump Height, Range of Motion etc.

We could potentially see their movements being separated into 3 second loops which save and are replayed, representing how the training data is segmented.

Based on the poses they strike and the movements they perform these will be ‘saved’ to a location within the ‘LSTM Galaxy’ determined by the values from the tracking data.

Movements and choreographies are represented within the ‘Galaxy’ as spheres / stars / planets and visualised on screen. We can zoom into these spheres to see videos of the movements contained within them (the video will only show the avatar / representation performing the movements, not a video of the person).

The experience consists of four phases:

Prompting / Cueing Realtime Recording Analysis / Inference Mapping to Latent Space / Galaxy

In this interactive experience, a single participant enters a designated zone where their movements and gestures are tracked by cameras. Positioned to face an LED screen and the cameras, with their back to any surrounding audience, the participant is guided through a series of prompts encouraging them to move, dance, pose, mimic, wave, or jump. To inspire creative movement, the experience may begin with a brief demonstration of example movements or choreographies.

The experience unfolds in four phases:

Prompting/Cueing: The participant receives a cue to start the experience, encouraging them to engage in various movements.
Realtime Recording: As they move, a tracked avatar or skeletal representation of themselves appears on the screen, accompanied by dynamic graphics displaying real-time tracking data, such as Position/Coordinates (X, Y, Z), Velocity, Acceleration, and other motion metrics. Movements may be captured in 3-second loops that replay, illustrating how the data is segmented.
Analysis/Inference: The participant’s movements are analyzed, and their poses and gestures are mapped according to the tracking data.
Mapping to Latent Space/Galaxy: The recorded movements are visualized as spheres, stars, or planets within a ‘LSTM Galaxy’ on the screen. Each sphere represents a choreography, with videos of the avatar performing the movements available upon zooming in.

Throughout the experience, participants see their actions translated into a cosmic visual representation, creating a unique and immersive interaction that bridges movement with data-driven art.