Publications and Research
Document Type
Poster
Publication Date
5-8-2025
Abstract
The virtualization of Javanese shadow puppetry (Wayang Kulit) offers a unique opportunity to preserve and revitalize traditional performance art through immersive digital platforms. This project explores the development of a virtual Wayang Kulit experience using real-time 3D engines like Unity/Unreal Engine while focusing on simulating the mechanics and aesthetics of shadow puppet performance. The puppets are designed using detailed 2D planes and rigged with skeletal systems to reflect the stylized motion of traditional puppetry. An aspect of this project is integrating an AI-driven control system that autonomously animates the puppets, learning from recorded puppeteer performances to replicate gesture, rhythm, and narrative flow. This approach aims to enhance interactivity and provide a more authentic representation of Wayang performances in digital form. This work contributes to digital heritage preservation and AI-driven performance arts, creating new pathways for cultural education, engagement, and creative reinterpretation
Included in
Artificial Intelligence and Robotics Commons, Graphics and Human Computer Interfaces Commons, Interactive Arts Commons, Interdisciplinary Arts and Media Commons, Theatre and Performance Studies Commons
Comments
This poster, first place winner for group projects, was presented at the 42nd Semi-Annual Dr. Janet Liou-Mark Honors & Undergraduate Research Poster Presentation, May 8, 2025. Mentor: Prof. David Smith (Entertainment Technology).
Python code available at https://github.com/JanGustau17/AI_PUPPET_MEDIAPIPE