Digital Musical Interactions: Performer–system relationships and their perception by spectators

This article adopts an ecological view of digital musical interactions, considering first the relationship between performers and digital systems, and then spectators’ perception of these interactions. We provide evidence that the relationships between performers and digital music systems are not necessarily instrumental in the same was as they are with acoustic systems, and nor should they always strive to be. Furthermore, we report results of a study indicating that spectators may not perceive such interactions in the same way as performances with acoustic musical instruments. We present implications for the design of digital musical interactions, suggesting that designers should embrace the reality that digital systems are malleable and dynamic, and may engage performers and spectators in different modalities, sometimes simultaneously.

[1]  Kosuke Kato,et al.  Effect of room acoustics on musicians' performance , 2010 .

[2]  Paul Stapleton,et al.  Examining the Spectator Experience , 2010, NIME.

[3]  Kosuke Kato,et al.  Effect of room acoustics on musicians' performance. part I: Experimental investigation with a conceptual model , 2010 .

[4]  M. Leman,et al.  Musical gestures : sound, movement, and meaning , 2010 .

[5]  Claude Cadoz,et al.  Supra-Instrumental Interactions and Gestures , 2009 .

[6]  Isabella Poggi,et al.  Gestures in performance , 2009 .

[7]  Marcelo M. Wanderley,et al.  Music and Motion: How Music-Related Ancillary Body Movements Contribute to the Experience of Music , 2009 .

[8]  Georg Essl,et al.  Do Mobile phones Dream of Electric Orchestras? , 2009, ICMC.

[9]  Linda Candy,et al.  Designing and evaluating virtual musical instruments: facilitating conversational user interaction , 2008 .

[10]  Victor Lazzarini.  Erratum: New Digital Musical Instruments: Control and Interaction Beyond the Keyboard , 2008, Computer Music Journal.

[11]  I. Chambers.  THE AURAL WALK , 2008 .

[12]  Michael Gurevich,et al.  Expression and its discontents: toward an ecology of musical creation , 2007, NIME '07.

[13]  Carol Parkinson,et al.  Proceedings of the 7th international conference on New interfaces for musical expression , 2007 .

[14]  Perry R. Cook,et al.  Don't forget the laptop: using native input capabilities for expressive musical control , 2007, NIME '07.

[15]  A. Friberg,et al.  Visual Perception of Expressiveness in Musicians' Body Movements , 2007 .

[16]  C. Stevens,et al.  Music, movement and marimba: an investigation of the role of movement and gesture in communicating musical expression to an audience , 2009 .

[17]  Ben Matthews,et al.  Easy doesn’t do it: skill and expression in tangible aesthetics , 2007, Personal and Ubiquitous Computing.

[18]  Gil Weinberg,et al.  Toward Robotic Musicianship , 2006, Computer Music Journal.

[19]  C. Krumhansl,et al.  Cross-modal interactions in the perception of musical performance , 2006, Cognition.

[20]  Elaine King,et al.  Music and Gesture , 2006 .

[21]  Christopher Dobrian,et al.  The 'E' in NIME: Musical Expression with New Computer Interfaces , 2006, NIME.

[22]  Peter Gall Krogh,et al.  Proceedings of the 4th decennial conference on Critical computing: between sense and sensibility , 2005, Critical Computing.

[23]  Jacob Buur,et al.  Designing the user actions in tangible interaction , 2005, Critical Computing.

[24]  Eric Clarke,et al.  Ways of Listening , 2005 .

[25]  Eduardo Reck Miranda,et al.  Interfacing the Brain Directly with Musical Systems: On Developing Systems for Making Music with Brain Signals , 2005, Leonardo.

[26]  Eric Clarke,et al.  Ways of Listening: An Ecological Approach to the Perception of Musical Meaning , 2005 .

[27]  I. Cross.  Music and meaning, ambiguity and evolution , 2005 .

[28]  Cornelius Pöpel,et al.  On interface expressivity: A player based study , 2005, NIME.

[29]  Marcelo M. Wanderley,et al.  The Musical Significance of Clarinetists' Ancillary Gestures: An Exploration of the Field , 2005 .

[30]  Alan F. Blackwell,et al.  The Programming Language as a Musical Instrument , 2005, PPIG.

[31]  R. Hatten,et al.  Interpreting Musical Gestures, Topics, and Tropes: Mozart, Beethoven, Schubert , 2004 .

[32]  Marcelo M. Wanderley,et al.  Gestural control of sound synthesis , 2004, Proceedings of the IEEE.

[33]  Perry R. Cook,et al.  "On-the-fly Programming: Using Code as an Expressive Musical Instrument" , 2004, NIME.

[34]  Anthony J. Hornof,et al.  EyeMusic: Making Music with the Eyes , 2004, NIME.

[35]  Kim Cascone.  LAPTOP MUSIC – COUNTERFEITING AURA IN THE AGE OF INFINITE REPRODUCTION , 2004 .

[36]  Caleb Stuart.  The Object of Performance: Aural Performativity in Contemporary Laptop Music , 2003 .

[37]  Kim Cascone,et al.  Grain, Sequence, System: Three Levels of Reception in the Performance of Laptop Music , 2003 .

[38]  Nick Collins.  Generative Music and Laptop Performance , 2003 .

[39]  Nick Collins,et al.  Live coding in laptop performance , 2003, Organised Sound.

[40]  W. Andrew Schloss,et al.  Using Contemporary Technology in Live Performance: The Dilemma of the Performer , 2003 .

[41]  François Pachet,et al.  The Continuator: Musical Interaction With Style , 2003, ICMC.

[42]  Matthew Wright,et al.  Problems and Prospects for Intimate Musical Control of Computers , 2002, Computer Music Journal.

[43]  Austin Henderson,et al.  Making sense of sensing systems: five questions for designers and researchers , 2002, CHI.

[44]  Laboratorio Nacional de Música Electroacústica.  Proceedings of the 2001 International Computer Music Conference, ICMC 2001, Havana, Cuba, September 17-22, 2001 , 2001, ICMC.

[45]  R. A. Carlson,et al.  Acquisition of intellectual and perceptual-motor skills. , 2001, Annual review of psychology.

[46]  George E. Lewis.  Too Many Notes: Computers, Complexity and Culture in Voyager , 2000, Leonardo Music Journal.

[47]  David Toop,et al.  Ocean of Sound: Aether Talk, Ambient Sound and Imaginary Worlds , 2000 .

[48]  T. Ingold.  The perception of the environment : essays on livelihood, dwelling and skill , 2000 .

[49]  Ross Kirk,et al.  Mapping Strategies for Musical Performance , 2000 .

[50]  Marcelo M. Wanderley,et al.  Trends in Gestural Control of Music , 2000 .

[51]  P. Juslin.  Emotional Communication in Music Performance: A Functionalist Perspective and Some Data , 1997 .

[52]  P. Juslin,et al.  Emotional Expression in Music Performance: Between the Performer's Intention and the Listener's Experience , 1996 .

[53]  Barry Truax,et al.  The Inner and Outer Complexity of Music , 1994 .

[54]  C. Cadoz,et al.  Le geste canal de communication homme/machine: la communication "instrumentale" , 1994 .

[55]  Donald A. Norman,et al.  Things That Make Us Smart: Defending Human Attributes In The Age Of The Machine , 1993 .

[56]  J. Davidson.  Visual Perception of Performance Manner in the Movements of Solo Musicians , 1993 .

[57]  R. Benjamin Knapp,et al.  A Bioelectric Controller for Computer Music Applications , 1990 .

[58]  Jeff Pressing.  Cybernetic Issues in Interactive Performance Systems , 1990 .

[59]  E. Clarke,et al.  The perception of expressive timing in music , 1989, Psychological research.

[60]  Alf Gabrielsson,et al.  Timing in music performance and its relations to music experience. , 1988 .

[61]  T Nakamura,et al.  The communication of dynamics between musicians and listeners through musical performance. , 1989, Perception & psychophysics.

[62]  E. Leach.  Culture and communication: the logic by which symbols are connected , 1977 .

[63]  E. Leach.  Culture & communication: Frontmatter , 1976 .

[64]  G. Johansson.  Visual perception of biological motion and a model for its analysis , 1973 .

[65]  J. Shaoul.  Human Error , 1973, Nature.

[66]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .