Give Me a Sign

    tech art installation

    Give Me a Sign is a tech art installation that uses gestural recognition to present interactive narratives through film. Created collaboratively by India based artist, Upasana Nattoji Roy and UK based artist, Diane Edwards, this art project is an inquiry whether Ai tools can augment our artistic practices and production processes.

    2024tech artAIgestural recognitioninteractive

    Awards & Mentions

    Give Me a Sign - Featured in STIR World
    Give Me a Sign - Featured in Animation Xpress

    Give Me a Sign is an immersive, interactive art installation that merges early versions of gestural recognition technology with evocative audiovisual storytelling to create compelling reflections on climate change and human behavior.

    Participants interact through gestures that guide the narratives, engaging directly with a thought-provoking exploration of themes including Earth & Water, Life & Growth, Human Ego, Tech, Power, and Caveat. At the heart of the installation is Shunya, a fictitious AI entity who embodies each thematic narrative through a striking combination of dance choreography, motion design, animation, and spoken word poetry. Shunya serves as both narrator and interlocutor, challenging viewers to reconsider their personal responsibility and the broader human impact on the environment. By integrating poetic statements, reflective questions, and engaging visual metaphors, Give Me a Sign transforms interaction into meaningful introspection.

    The project's artistic and technological ambition extends beyond storytelling to examine the role of artificial intelligence in augmenting human creativity. Throughout development, AI tools played a crucial role, particularly in the use of motion-capture techniques. Video-based motion capture was utilized to extract animation keyframes, which were then integrated within the Unreal Engine, and eventually further developed on After Effects, showcasing a hybrid workflow blending human performance with AI-driven animation.

    Give Me a Sign is both a meditation on urgent global challenges and an exploration of how AI technologies can amplify artistic expression and collaboration. By harnessing the expressive potential of gestural interaction and animation, it redefines contemporary animation art, inviting viewers not merely to observe, but to participate deeply in the dialogue about our shared ecological future.

    Give Me a Sign - Participants interacting with gestural recognition interface
    Give Me a Sign - Team members at the exhibition
    Give Me a Sign - Panel discussion with artists and technologists
    Give Me a Sign - Installation setup showing interactive display
    Give Me a Sign - Exhibition poster and installation view
    Give Me a Sign - Performer demonstrating gestural interaction with visual content
    Give Me a Sign - Interactive themes including Human Ego display
    Give Me a Sign - Animated visual content with environmental themes
    Give Me a Sign - Interactive display showing Life & Growth theme
    Give Me a Sign - Immersive installation entrance with thematic panels
    Give Me a Sign - Dark room installation with 'the last fish caught' projection
    Give Me a Sign - Children interacting with Earth & Water theme through draped entrance
    Give Me a Sign - Full team photo at exhibition venue
    Give Me a Sign - Artists at installation entrance with Shunya interface visible
    Give Me a Sign - Interactive setup with projection and gestural control interface
    Give Me a Sign - Exhibition card with gestural hand constellation logo
    Give Me a Sign - Visitors experiencing the gesture-based interface
    Give Me a Sign - Evening installation showing all six theme gestures interface
    Give Me a Sign - Visitor silhouetted against Life & Growth projection through decorative entrance
    Give Me a Sign - Visitor entering through traditional textile-framed entrance
    Give Me a Sign - Interactive demonstration with gestural interface and projection
    Give Me a Sign - Participant performing gesture with illuminated hand interface
    Give Me a Sign - Behind-the-scenes view of installation setup and equipment
    Give Me a Sign - Installation entrance panel with branding and textile drapes

    Give Me A Sign premiered a prototype at the Future Fantastic Festival at HOME in Manchester, United Kingdom which was held on 25th and 26th February 2023. It also featured at Rangashankara in Bangalore on the 11th and 12th of March 2023 and at Bangalore International Centre on from the 24th to 26th of March 2023.

    2023 Give Me a Sign Project was supported by:

    HOME Manchester
    Future Fantastic Festival
    Be Fantastic
    British Council India/UK Together Season of Culture
    Future Everything

    The Experience

    This audiovisual experience combines aspects of Indian philosophy and practices with narratives around Artificial Intelligence and the impact of human actions on our planet, through an illusionary AI entity called 'Shunya' who responds to certain Indian dance mudras with visions and dreams, stories, concerns and hopes for our changing planet.

    The experience starts at an animating interface. When someone holds up a mudra / hand gesture in front of the webcam, it triggers an audio visual response on the screen. Shunya manifests as hands and a voice in an animated speculative world and informs the user about the theme in the form of a statement, a philosophical observation or a leading question.

    For this prototype of Give me a Sign, the focus is on six topics related to human impact on climate change. These topics were chosen by the two artists, based on the urgency for action.

    "The use of gestures in communication is a defining characteristic of the human species"

    — Upasana

    The Process

    Why Mudras - Process illustration

    Mudras are hand gestures that are used to communicate and express emotions or ideas without using words typically used in classical Indian dance. The process of studying and curating from a vast repository of mudras from the Bharata Natya Shastra was done in tandem with researching the themes related to human impact on our planet.

    Using Artificial Intelligence - Process illustration

    The research included traditional forms as well as ChatGPT3. The scripts needed to be written by the artists. Each gesture was mapped to a theme like Earth & Water, Life & Growth, Human Ego, Tech, Power & Caveat. 3 scripts were written for each - a statement, a poetic thought or a leading question.

    Shunya creation process

    Shunya was created through dance choreography by Upasana, motion captured through DeepMotion (ai tool) and the animation was retargeted onto Metahuman hands in Unreal Engine. Shunya is designed to be able to respond with gestures, yet abstracted from a full human.

    Augmented Intelligence workflow

    The process has been an exploration of possibilities in creative and production workflows. Upasana sees AI as 'Augmented Intelligence' and currently sees machine learning tools as an augmentation to her design and artistic practice. Switch Studio is already developing collaborative workflows using traditional, digital as well as AI Tools.

    Give me a Sign has been designed with the possibility of being experienced in two formats

    Immersive

    An interactive immersive experience typically projected or a high resolution led wall with immersive sound.

    Popup

    Using a TV setup as a display and a simple laptop along with a connected camera setup for image capture.