“V F C: An Adaptive Cinema Experience Powered by Brain-computer Interface” presented by Roy, Bellemare-Pepin, Harel and Lambert





Session Title:

ISEA Artist Talks

Presentation Title:

V F C: An Adaptive Cinema Experience Powered by Brain-computer Interface

Presentation Subtheme:

Speculative practices

Abstract:

V F C is a live cinematographic feature-length experience that takes advantage of mobile electroencephalography (EEG) to provide the filmgoers with a customized soundtrack offered through a novel hybrid sound system approach. The movie takes viewers on an unsettling journey during which they follow a female neuroscientist facing the shadows of her own mind, instantiating a form of reversed mise en abyme which gives a role to the spectator’s mental states to play in diegetic and extra-diegetic sound elements. It relies on VFC BiomediæTM, a technological platform designed to support a multi-user adaptive media experience by tailoring the movie soundtrack in real-time to one’s reactions to the cinematographic content. The platform is composed of a data acquisition system with real-time signal processing capabilities, a modular soundtrack built and operated via live music software, and a dual audio system based on bone-conduction earphones supplementing typical cinema speakers. We hope this piece fosters innovative strides in adaptive storytelling, paving the way for future explorations into how technology-driven personalization can transform the cinematic experience.

Category:

undefined
undefined