Liveness and Flow in Notation Use

This paper presents concepts, models, and empirical findings relating to liveness and flow in the user experience of systems mediated by notation. Results from an extensive two-year field study of over 1,000 sequencer and tracker users, combining interaction logging, user surveys, and a video study, are used to illustrate the properties of notations and interfaces that facilitate greater immersion in musical activities and domains, borrowing concepts from programming to illustrate the role of visual and musical feedback, from the notation and domain respectively. The Cognitive Dimensions of Notations framework and Csikszentmihalyi’s flow theory are combined to demonstrate how non-realtime, notation-mediated interaction can support focused, immersive, energetic, and intrinsicallyrewarding musical experiences, and to what extent they are supported in the interfaces of music production software. Users are shown to maintain liveness through a rapid, iterative editaudition cycle that integrates audio and visual feedback.

[1]  Philip Auslander,et al.  Liveness: Performance in a Mediatized Culture , 1999 .

[2]  Chris Nash.  Supporting virtuosity and flow in computer music , 2012 .

[3]  R. Eklund,et al.  Assessing Flow in Physical Activity: The Flow State Scale-2 and Dispositional Flow Scale-2 , 2002 .

[4]  L. Davidson,et al.  Discerning Musical Development: Using Computers to Discover What We Know , 1988 .

[5]  Steven L. Tanimoto,et al.  VIVA: A visual language for image processing , 1990, J. Vis. Lang. Comput..

[6]  Alan F. Blackwell,et al.  A Cognitive Dimensions questionnaire optimised for users , 2000, PPIG.

[7]  Ben Shneiderman,et al.  Design Principles for Tools to Support Creative Thinking , 2005 .

[8]  Alan F. Blackwell,et al.  Tracking Virtuosity and Flow in Computer Music , 2011, ICMC.

[9]  Carla S. Williams,et al.  A visual language for image processing , 1990, Proceedings of the 1990 IEEE Workshop on Visual Languages.

[10]  Matthew Duignan,et al.  Computer Mediated Music Production: a Study of Abstraction and Activity , 2008 .

[11]  Martin H. Levinson.  Creativity: Flow and the Psychology of Discovery and Invention , 1997 .

[12]  M. Leman.  Embodied Music Cognition and Mediation Technology , 2007 .

[13]  E. Jones,et al.  A grounded theory approach to modelling learnability of hypermedia authoring tools , 2002, Interact. Comput..

[14]  Alan F. Blackwell,et al.  Flow of Creative Interaction with Digital Music Notations , 2014 .

[15]  Alan F. Blackwell,et al.  Liveness in Notation Use: From Music to Programming , 2010, PPIG.

[16]  Marian Petre,et al.  Usability Analysis of Visual Programming Environments: A 'Cognitive Dimensions' Framework , 1996, J. Vis. Lang. Comput..

[17]  John Croft,et al.  Theses on liveness , 2007, Organised Sound.