The Perception of Live-sequenced Electronic Music via Hearing and Sight

In this paper, we investigate how watching a live-sequenced electronic music performance, compared to merely hearing the music, contributes to spectators' experiences of tension. We also explore the role of the performers' effective and ancillary gestures in conveying tension, when they can be seen. To this end, we conducted an experiment where 30 participants heard, saw, or both heard and saw a live-sequenced techno music performance recording while they produced continuous judgments on their experience of tension. Eye tracking data was also recorded from participants who saw the visuals, to reveal aspects of the performance that influenced their tension judgments. We analysed the data to explore how auditory and visual components and the performer's movements contribute to spectators' experience of tension. Our results show that their perception of emotional intensity is consistent across hearing and sight, suggesting that gestures in live-sequencing can be a medium for expressive performance.

[1]  Till Bovermann,et al.  Audience Experience in Sound Performance , 2013, NIME.

[2]  Paul Stapleton,et al.  Spectator understanding of error in performance , 2009, CHI Extended Abstracts.

[3]  M. Gurevich,et al.  Digital Musical Interactions: Performer–system relationships and their perception by spectators , 2011, Organised Sound.

[4]  Paul Stapleton,et al.  Examining the Spectator Experience , 2010, NIME.

[5]  Hans-Georg Müller,et al.  Functional Data Analysis , 2016 .

[6]  Emery Schubert.  Correlation analysis of continuous emotional response to music: Correcting for the effects of serial correlation , 2001 .

[7]  Paul Stapleton,et al.  Where Did It All Go Wrong ? A Model of Error From the Spectator's Perspective , 2009, NIME.

[8]  A. Friberg,et al.  Visual Perception of Expressiveness in Musicians' Body Movements , 2007 .

[9]  Steve Benford,et al.  Designing the spectator experience , 2005, CHI.

[10]  C. Stevens,et al.  Music, movement and marimba: an investigation of the role of movement and gesture in communicating musical expression to an audience , 2009 .

[11]  Sidney Fels,et al.  Mapping transparency through metaphor: towards more expressive musical instruments , 2002, Organised Sound.

[12]  Christopher Dobrian,et al.  The 'E' in NIME: Musical Expression with New Computer Interfaces , 2006, NIME.

[13]  Veronica Teichrieb,et al.  Considering Audience's View Towards an Evaluation Methodology for Digital Musical Instruments , 2012, NIME.

[14]  Ben Bengler.  The audio mixer as creative tool in musical composition and performance , 2011 .

[15]  Marcelo M. Wanderley,et al.  The Musical Significance of Clarinetists' Ancillary Gestures: An Exploration of the Field , 2005 .

[16]  References , 1971 .

[17]  C. Krumhansl,et al.  Cross-modal interactions in the perception of musical performance , 2006, Cognition.

[18]  J. Ramsay,et al.  Introduction to Functional Data Analysis , 2007 .