Hands where we can see them! Investigating the impact of gesture size on audience perception

This paper explores the relative effect of gesture size on audience perception of digital musical instrument (DMI) performance. In a study involving a total audience of 28 people (split into 2 groups of 13 and 15), we used a small and large version of a DMI to examine how the size of performers’ gestures might differ, and how this affects post-hoc audience ratings of enjoyment, interest and understanding, as well as their indications of ‘enjoyment’ and ‘error’ in real time. For each audience we held two 5-minute performances, the first on a custom-designed percussion DMI, and the second on a laptop. The DMI used in each performance was made up of three elements identical in shape, materiality, interaction and sound, but the physical size was different: For one each element was approx 12x10x5cm, and the other was about 3.5 times bigger (approx. 40x30x20cm). Data was collected both during and after the performance via post-hoc and real-time methods. We found that beyond a performance simply involving physical gesture, the size of gesture has an impact on audience ratings. In this paper we detail this study and its results, and present the implications that this finding has for DMI design.

[1]  Jennifer G. Sheridan,et al.  Designing for performative tangible interaction , 2008, Int. J. Arts Technol..

[2]  Chia-Jung Tsay Sight over sound in the judgment of music performance , 2013, Proceedings of the National Academy of Sciences.

[3]  Matthew Wright,et al.  Problems and Prospects for Intimate Musical Control of Computers , 2002, Computer Music Journal.

[4]  E. Loftus,et al.  Reconstruction of automobile destruction: An example of the interaction between language and memory , 1974 .

[5]  Andrew P. McPherson,et al.  Dimensionality and Appropriation in Digital Musical Instrument Design , 2014, NIME.

[6]  G Moro,et al.  Making High-Performance Embedded Instruments with Bela and Pure Data , 2016 .

[7]  Fabio Morreale,et al.  In-the-moment and Beyond: Combining Post-hoc and Real-Time Data for the Study of Audience Perception of Electronic Music Performance , 2017, INTERACT.

[8]  Victor Lazzarini Erratum: New Digital Musical Instruments: Control and Interaction Beyond the Keyboard , 2008, Computer Music Journal.

[9]  Paul Stapleton,et al.  Examining the Spectator Experience , 2010, NIME.

[10]  J. D'Escrivan To sing the body electric: Instruments and effort in the performance of electronic music , 2006 .

[11]  W. Andrew Schloss,et al.  Using Contemporary Technology in Live Performance: The Dilemma of the Performer , 2003 .

[12]  Paul Stapleton,et al.  Where Did It All Go Wrong ? A Model of Error From the Spectator's Perspective , 2009, NIME.

[13]  Marcelo M. Wanderley,et al.  A Comprehensive Review of Sensors and Instrumentation Methods in Devices for Musical Expression , 2014, Sensors.

[14]  Marc Leman,et al.  A multi-layered Conceptual Framework for Expressive Gesture Applications , 2001 .

[15]  M. Sile O'Modhrain,et al.  A Framework for the Evaluation of Digital Musical Instruments , 2011, Computer Music Journal.

[16]  Nick Bryan-Kinns,et al.  Skip the Pre-Concert Demo: How Technical Familiarity and Musical Style Affect Audience Response , 2016, NIME.

[17]  M. Leman,et al.  Musical gestures : sound, movement, and meaning , 2010 .

[18]  Nicola Orio,et al.  Evaluation of Input Devices for Musical Expression: Borrowing Tools from HCI , 2001, Computer Music Journal.

[19]  Shuji Hashimoto,et al.  EyesWeb: Toward Gesture and Affect Recognition in Interactive Dance and Music Systems , 2000, Computer Music Journal.

[20]  S. Jordà Instruments and Players: Some Thoughts on Digital Lutherie , 2004 .

[21]  David Zicarelli Music Technology as a Form of Parasite , 1992, ICMC.

[22]  Alexander Refsum Jensenius,et al.  To gesture or Not? An Analysis of Terminology in NIME Proceedings 2001-2013 , 2014, NIME.

[23]  James J. Gibson,et al.  The Ecological Approach to Visual Perception: Classic Edition , 2014 .

[24]  G. Paine Towards Unified Design Guidelines for New Interfaces for Musical Expression , 2009, Organised Sound.

[25]  P. Janata,et al.  Embodied music cognition and mediation technology , 2009 .

[26]  Steve Benford,et al.  Designing the spectator experience , 2005, CHI.

[27]  Sidney Fels,et al.  Mapping transparency through metaphor: towards more expressive musical instruments , 2002, Organised Sound.