“Enhancing Embodied Telepresence in First-Person View Drone Pilots through Real-Time Data-Driven Sound Design” presented by Swope

Symposium:

• ISEA2024: 29th International Symposium on Electronic Art

• Sound (full papers)

• Enhancing Embodied Telepresence in First-Person View Drone Pilots through Real-Time Data-Driven Sound Design

• Speculative practices

• Samuel Adam Swope

Venue(s):

• Brisbane Convention & Exhibition Centre, Brisbane, Australia

• This academic paper investigates the integration of real-time, data-driven sound design and construction within the context of first-person view (FPV) drone piloting. The objective of this study is to enhance the sense of embodied telepresence experienced by FPV drone pilots. The paper addresses several research gaps and questions, including the potential for shared experiences between the human body and the drone machine, the impact of different sound designs on the overall piloting experience, and the influence of new ocular and aural feedback on the pilot’s understanding of aerodynamic position and movement. Additionally, the paper examines the limitations of current human-drone sensory overlay and emphasizes the necessity for a widely applicable methodology for aural sensory stimulation in drone operation. The research methodology encompasses the development of a physical prototype and the exploration of flight controller data sonification. The paper concludes with an evaluation of the prototype and the identification of areas that require further research and improvement, laying the foundation for integrating sound design into FPV drone control systems and opening up new possibilities for creating immersive and dynamic airborne art.

Keywords:

• art and technology
• Embodied telepresence
• First-person view (FPV) drone piloting
• Real-time data-driven sound design
• Algorithmic composition
• Physical Computing
• Human-Machine Relationships
• Spatial awareness
• Multisensorial interface
• Sonification of flight controller data

Category:

• Long Paper