top of page

Gestura.

Date. 2023

City. New York

Size. 12*2*2 in

Team members. 

Kefan Lyu

Kyrie Yang

Alan Ren

Muqing Wang

Early prototype at NYU

New developed and performed with MYO band at BrainCo

Project Description

​

Gestura is a wearable device that revolutionizes the performing arts by empowering artists with cerebral palsy and limited speech abilities. Gestura represents a transformative approach to stage performance and real-time expression, transcending traditional boundaries of communication. It redefines the intersection of technology and art, extending its reach to artists across disciplines. As a gesture-based system, Gestura enables performers to manipulate the nuances of sounds and visuals through the simple movement of their fingers or arms. This innovative technology not only expands the realm of possibility for those with speech limitations but also offers a new dimension of expression for the artistically adventurous. Each movement becomes a brush stroke in a stage canvas, allowing the seamless integration of sound and visuals with physical expression. Gestura's user-centric design is the cornerstone of its inclusivity, inviting individuals to customize its functions to their unique expressive body language. It is a testament to the power of adaptive technology to not just overcome barriers but to create an entirely new lexicon of artistic vocabulary. With Gestura, the body speaks in tones, and movement resonates with the voice of creativity.

Contribution​

  • Led the audio development with Max/MSP/Jitter for Gestura, translating gestures into auditory feedback, focusing on expressive, responsive audio landscapes.

  • Directed and produced feature concept videos for Gestura, employing advanced video editing techniques to visually articulate the product's innovative gesture-to-audio capabilities.

  • Integrated hardware and software in user-centered assistive tech with cross-functional teams to highlight the potential of non-invasive BCI product.

  • Successfully deployed fully operational, gesture-controlled device at BrainCo, showcasing assistive technology solutions.

Technical Details

  • Hand-made leather glove and arm strap that fits most people.

  • Arduino Nano 33 IoT

    • Flex Sensors

    • Soft Potentiometer

    • Accelerometer

    • Gyroscope

    • Wifi

    • 9V Battery

  • TouchDesigner - Visual

  • Max/MSP/Jitte - Audio

61712478515_.pic.jpg
71712478530_.pic.jpg
81712478564_.pic.jpg
  • Instagram
  • LinkedIn

© 2025 by Kefan Lyu

bottom of page