Flip the Book, Flip the Memories: a Case Study of Multimodal Interaction for the Library Located in Macao World Heritage Site

Symposium:

• ISEA2016: 22nd International Symposium on Electronic Art
• More presentations from ISEA2016:  

• Cultural Heritage, Sites of

• Flip the Book, Flip the Memories: a Case Study of Multimodal Interaction for the Library Located in Macao World Heritage Site

• Mei-Kei Lai

Venue(s):

• Run Run Shaw Creative Media Centre, Kowloon Tong, Hong Kong SAR China

• Abstract (short paper)

  “Flip the Book – Flip the Memories” is a multimodal interactive artwork exhibited in Sir Robert Ho Tung Library, which is part of Macao World Heritage site. This artwork integrates smell with audio visual together into reading experience. When the reader turns the page of the physical book, it would trigger different videos projected on the book. Meanwhile, specific scents would be released from the side according to the videos. The video footages are collected from local video photographers, which have preciously captured the images of the old days in Macao. This artwork uses smell as an ambient medium to connect the present with the past. It aims to lead the readers to recall their memories from the past, also to think about the present while being surrounded by the environment of cultural heritage. By combining physical book with multimodal interaction, this artwork brings the cultural heritage visitors tangible and intangible experience altogether. This paper would take “Flip the Book – Flip the Memories” as the case study to discuss the opportunities and the challenges behind while bringing new media into cultural heritage, especially the role of olfaction in multimodal interaction.

• [View Full Paper/Presentation]

Category:

• Paper
• Short Paper