A user experience review of music interaction evaluations

The need for thorough evaluations is an emerging area of interest and importance in music interaction research. As a large degree of DMI evaluation is concerned with exploring the subjective experience: ergonomics, action-sound mappings and control intimacy; User Experience (UX) methods are increasingly being utilised to analyse an individual's experience of new musical instruments, from which we can extract meaningful, robust findings and subsequently generalised and useful recommendations. However, many music interaction evaluations remain informal. In this paper, we provide a meta-review of 132 papers from the 2014 -- 2016 proceedings of the NIME, SMC and ICMC conferences to collate the aspects of UX research that are already present in music interaction literature, and to highlight methods from UX's widening field of research that have not yet been explored. Our findings show that usability and aesthetics are the primary focus of evaluations in music interaction research, and other important components of the user experience such as enchantment, motivation and frustration are frequently if not always overlooked. We argue that these factors are prime areas for future research in the field and their consideration in design and evaluation could lead to a better understanding of NIMEs and other computer music technology.

[1]  Sergi Jordà Digital Lutherie Crafting musical computers for new musics' performance and improvisation , 2005 .

[2]  Duncan Williams,et al.  Affective Jukebox: A Confirmatory Study of EEG Emotional Correlates in Response to Musical Stimuli , 2014, ICMC.

[3]  Kasper Hornbæk,et al.  Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience , 2011, CHI.

[4]  Johan Kildal,et al.  Non-intrusive Counter-actions: Maintaining Progressively Engaging Interactions for Music Performance , 2016, NIME.

[5]  Peter C. Wright,et al.  The experience of enchantment in human–computer interaction , 2006, Personal and Ubiquitous Computing.

[6]  Christopher Dobrian,et al.  The 'E' in NIME: Musical Expression with New Computer Interfaces , 2006, NIME.

[7]  Marcelo M. Wanderley,et al.  Towards a dimension space for musical devices , 2005 .

[8]  Geraldine Fitzpatrick,et al.  HCI Methodology For Evaluating Musical Controllers: A Case Study , 2008, NIME.

[9]  Mikkel Helleberg Jørgensen,et al.  A mobile music museum experience for children , 2015, NIME.

[10]  Nicola Orio,et al.  Evaluation of Input Devices for Musical Expression: Borrowing Tools from HCI , 2001, Computer Music Journal.

[11]  Mark Blythe,et al.  Funology:From Usability to Enjoyment , 2003 .

[12]  Virpi Roto,et al.  Understanding, scoping and defining user experience: a survey approach , 2009, CHI.

[13]  D. McInerney Motivation , 2019, Educational Psychology.

[14]  Andrew P. McPherson,et al.  Exposing the scaffolding of digital instruments with hardware-software feedback loops , 2015, NIME.

[15]  Federico Fontana,et al.  An exploration on whole-body and foot-based vibrotactile sensitivity to melodic consonance , 2016 .

[16]  Martin H. Levinson Creativity: Flow and the Psychology of Discovery and Invention , 1997 .

[17]  Jeremy R. Cooperstock,et al.  User-Driven Techniques for the Design and Evaluation of New Musical Interfaces , 2016, Computer Music Journal.

[18]  David G. Novick,et al.  Usability over time , 2005, SIGDOC '05.

[19]  Caroline Hummels,et al.  A designerly critique on enchantment , 2008, Personal and Ubiquitous Computing.

[20]  Sergi Jordà,et al.  Digital Instruments and Players: Part II-Diversity, Freedom and Control , 2004, ICMC.

[21]  Matthew Wright,et al.  Problems and prospects for intimate musical control of computers , 2001 .

[22]  A. Danto The transfiguration of the commonplace : a philosophy of art , 1982 .

[23]  Sidney Fels,et al.  Mapping transparency through metaphor: towards more expressive musical instruments , 2002, Organised Sound.

[24]  M. Sile O'Modhrain,et al.  A Framework for the Evaluation of Digital Musical Instruments , 2011, Computer Music Journal.

[25]  I. Olkin,et al.  Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement , 1999, The Lancet.

[26]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[27]  Peter Chapman,et al.  Engagement in multimedia training systems , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[28]  M. Thüring,et al.  Dynamics of User Experience 1 Dynamics of User Experience . Judgments of Attractiveness , Usability , and Emotions Over Time , 2016 .

[29]  Marcelo M. Wanderley,et al.  What does 'evaluation' mean for the nime community? , 2015, NIME.

[30]  Nick Bryan-Kinns,et al.  Skip the Pre-Concert Demo: How Technical Familiarity and Musical Style Affect Audience Response , 2016, NIME.

[31]  Michael Gurevich,et al.  Style and Constraint in Electronic Musical Instruments , 2010, NIME.

[32]  Mark D. Plumbley,et al.  Discourse Analysis Evaluation Method for Expressive Musical Interfaces , 2008, NIME.

[33]  Peter C. Wright,et al.  Interdisciplinary criticism: Analysing the experience of riot! a location-sensitive digital narrative , 2006, Behav. Inf. Technol..

[34]  Stefania Serafin,et al.  Longitudinal Evaluation of the Integration of Digital Musical Instruments into Existing Compositional Work Processes , 2012 .

[35]  Phoebe Sengers,et al.  The disenchantment of affect , 2008, Personal and Ubiquitous Computing.

[36]  Stefania Serafin,et al.  Design and evaluation of a gesture driven wave field synthesis auditory game , 2016, NIME.

[37]  Markku Turunen,et al.  Studying Aesthetics in a Musical Interface Design Process Through 'Aesthetic Experience Prism' , 2012, NIME.