“Hand Bone Frame Conversion for Motion Retargeting in a Body Motion Capture System to Manipulate Virtual Taiwanese Hand Puppet” presented by Lee, Pan, Hsu and Liu
Symposium:
Session Title:
- Immersion and VR (short papers)
Presentation Title:
- Hand Bone Frame Conversion for Motion Retargeting in a Body Motion Capture System to Manipulate Virtual Taiwanese Hand Puppet
Presentation Subtheme:
- Shifting temporalities
Presenter(s):
Venue(s):
Abstract:
Taiwanese hand puppet theater is a traditional craft with over a hundred years of history. This project merges Taiwanese hand puppet theater with technology, preserving its traditional quali-ties while breaking new ground. We used motion capture tech-nology for the transdisciplinary co-creation of three-dimensional animation and performance art. Taiwanese hand puppets are manipulated using the hand; the limitations of the bone frame of the hand create the unique movements of the humanoid puppets. Motion capture equipment cannot directly translate the human skeleton to the bone frame of the hand, and performers cannot physically imitate the motions of the hand. Thus, to enable motion capture equipment to manipulate a virtual Taiwanese hand puppet in real-time through a human body and make the virtual Taiwanese hand puppet move in the traditional manner, we wrote a puppetry system that converts the VRM of human skeletons to the bone frame of the hand. This system serves as reference for motion retargeting to ma-nipulate virtual puppets.
