Artistic Residency Tech and Art

2024-01-15 15:06 UTC gpt-4

Hi I need your help with so rephrasing. I am writting an executive summary of a research project as explained in the text below: The summary shall describe the main objectives of the experiment and overview of the mentoring established for this experiment. The Executive Summary should be maximum one page in total (tables of KPIs included separately). It will provide an abstract text that can be used for public communication purposes.

this is my text:

We’re approaching this residency with an idea that has been brewing within our team for a while, an urge to address the important questions of agency and emergent sentience of digital entities. As artists with significant experience in coding and art-directing real-time visuals for dance performances and interactive installations, we found ourselves wondering how we can break the norm of the typical “accompanying visuals” and “one-way reactivity” seen in most New Media performances. What if a truly sentient, algorithmic being with its own expectations, thought processes and agency existed, and became an active participant and equal performer in the show? Put simply, can thinking machines perform alongside humans?

With this ambition in mind, we embark on a journey of developing this Digital performer while reflecting upon its sensory system, means of interaction as well as -and perhaps more importantly- its Brain.

How would this Being understand the world around it? How would it elicit a human response, and in return, how would human actions influence its behaviour over time?

We believe the key point lies in the feedback loop between the audiovisual stimuli that the machine generates, and the complex multimodal ways humans -willingly or subconsciously- react to them.

Our ambitious proposal raises significant technical as well as artistic challenges which we will try to approach and tackle systematically with the invaluable guidance of our consortium partners at HLRS and SONY CSL.

On a technical level we aim to initially develop how our Digital Being will perceive and interpret the world around it as well as its physical counterpart. This twofold stream of research will focus on the one hand on the development of a robust multimodal tracking system and on the other hand, on the selection and training of the correct neural network architecture that will enable the machine to translate the incoming signals into substantial cues that will trigger a meaningful interaction between the two performers.

The second and most challenging stream of technical research will focus on the development of the Digital Being’s Brain, its intent and its available means of expression. We aim to train a Deep Reinforcement Learning Model through hours of targeted workshops with physical performers. At the same time we will conduct a series of experiments and workshops that will help us define the visual language through which the Digital performer will interact with the human performer. In this case, intent and language will be developed at the same time in an intertwined feedback loop.

Apart from the raw technical challenges, on an art direction level we are very interested in exploring the extents of behaviour determinism in either of the two performers. We are eager to explore the equilibrium between scripted and improvised behaviour without jeopardising the integrity of the performance as a meaningful interaction between two actors that differ in nature. The findings of that research will also guide the narrative development of our performative piece.

can you help me rephrase it and improve the language? I want it to have a casually scientific vibe but at the same time understandable and catchy for an artistic residency

Certainly! Here’s a rephrased version of your text that aims to maintain a balance between scientific insight and an engaging, artistic narrative suitable for an executive summary:

Executive Summary

In our latest artistic residency, we’re exploring a groundbreaking concept that’s been simmering in our team’s collective imagination: probing the realms of agency and emergent sentience in digital entities. As seasoned artists, adept in coding and directing real-time visual elements for dance and interactive installations, we’re challenging the status quo. Our vision transcends the traditional roles of passive visuals and predictable responses prevalent in New Media art. We ask: What if an algorithmic entity, endowed with its own consciousness, desires, and decision-making capabilities, co-starred as an equal performer in a live show? Is it possible for a ‘thinking’ machine to seamlessly integrate and perform in tandem with human artists?

Embarking on this creative odyssey, we are meticulously crafting this Digital Entity. Our focus extends to its sensory apparatus, interactive capabilities, and, crucially, its cognitive architecture - its ‘Brain’. This venture prompts fundamental questions: How will this digital being perceive and interact with its environment? How will it evoke and respond to human reactions, and how will these interactions evolve over time?

We’re convinced that the crux of this exploration lies in the dynamic interplay between the audiovisual outputs generated by the machine and the nuanced, often subconscious, human responses to these stimuli.

Our proposal presents formidable technical and artistic challenges. To navigate these, we’re collaborating closely with experts from HLRS and SONY CSL. Technically, our first goal is to develop the Digital Entity’s perceptual and interpretive abilities. This involves constructing a robust multimodal tracking system and selecting and training a neural network to transform incoming signals into meaningful interactive cues.

The second, more complex technical challenge involves developing the Digital Entity’s cognitive functions - its ‘Brain’, intentions, and expressive capabilities. We plan to refine a Deep Reinforcement Learning Model through extensive workshops with physical performers. Concurrently, we’ll experiment with defining the visual language enabling interaction between the digital and human performers, crafting both intent and language in a synergistic loop.

Beyond the technical aspects, from an art direction standpoint, we’re delving into the nuances of behavior determinism in both digital and human performers. Our aim is to balance scripted and spontaneous actions, ensuring the performance remains a coherent and engaging dialogue between two distinct entities. The insights from this research will significantly shape the narrative arc of our performance piece.

In summary, this residency is not just an artistic endeavor; it’s a pioneering exploration at the intersection of technology, art, and human-machine interaction, promising to redefine the boundaries of live performance.

This version aims to capture the essence of your project while making it accessible and intriguing to a wider audience, blending scientific rigor with artistic flair.