“Legend of Wrong Mountain: AI Generated Opera” presented by Huang, Jiang, Sun, Bai, Kang and Pczos
Symposium:
- ISEA2019: 25th International Symposium on Electronic Art
- More presentations from ISEA2019:
Session Title:
- Creative AI
Presentation Title:
- Legend of Wrong Mountain: AI Generated Opera
Presenter(s):
Venue(s):
Abstract:
As one of the oldest forms of Chinese Opera since the 16th century, Kunqu features literary virtuosity in its scripts, sophisticated vocal techniques in its singing, emotional and elegant yet rigorous bodily motions and facial expressions in its performance. Over its history, Kunqu has developed established modes and patterns, which makes it especially suitable for neural networks to learn. In order to generate Kunqu literature and performance computationally, we applied multiple machine learning and computer vision techniques. Our result, Legend of Wrong Mountain, is novel twofold: it is the first and only generated opera at the time of this writing, and it is a machine’s attempt at Gesamtkunstwerk [12], “the Total Artwork”. It explores the marriage between contemporary technologies and traditional art form. By studying historical scripts, musical notations and traditional methods for creating Kunqu, we tweaked existing algorithms and devised new ones to conform to the traditional rules and norms as closely as possible. We presented this project as a video accompanied by audio.