Patterns of Musical Interaction with Computing Devices

In line with the efforts from the Ubiquitous Music Group, our research identified recurring patterns of interaction between humans and computing devices in existing music software and hardware. These four kinds of repeatedly implemented musical interactions are being documented in the form of interaction design patterns, providing an alternative taxonomy of interaction types, suitable for musical and computational developments in ubiquitous music research. In this paper we briefly describe the meaning of patterns in design fields. We also defend the use of interaction patterns in the design of ubiquitous music systems, and present the four proto-patterns proposed in our research. We intend with this paper to foster discussions at this 3rd Ubimus workshop, which can lead to refinement and improvement of the proposed interaction design patterns.

[1]  Cristiano André da Costa,et al.  Toward a General Software Infrastructure for Ubiquitous Computing , 2008, IEEE Pervasive Computing.

[2]  Atau Tanaka.  Mobile Music Making , 2004, NIME.

[3]  Keith Robinson.  Ableton Live 8 , 2010 .

[4]  Keith Robinson.  SCENE 1 – Ableton Live 8: Create, Produce, Perform , 2009 .

[5]  Nicola Orio,et al.  Evaluation of Input Devices for Musical Expression: Borrowing Tools from HCI , 2001, Computer Music Journal.

[6]  Mahadev Satyanarayanan,et al.  Pervasive computing: vision and challenges , 2001, IEEE Wirel. Commun..

[7]  Jenifer Tidwell,et al.  Designing interfaces - patterns for effective interaction design , 2019 .

[8]  Marcelo Soares Pimenta,et al.  Patterns for the design of musical interaction with everyday mobile devices , 2010, IHC.

[9]  M. Weiser.  The Computer for the Twenty-First Century , 1991 .

[10]  Marcelo Soares Pimenta,et al.  CODES: a Web-based environment for cooperative music prototyping , 2005 .

[11]  Todd Winkler.  Composing Interactive Music: Techniques and Ideas Using Max , 1998 .

[12]  Jan O. Borchers.  A pattern approach to interaction design , 2001, DIS '00.

[13]  Charles Dodge,et al.  Computer Music: Synthesis, Composition, and Performance , 1997 .

[14]  Dirk Riehle,et al.  Understanding and Using Patterns in Software Development , 1996, Theory Pract. Object Syst..

[15]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[16]  Marcelo M. Wanderley,et al.  New Digital Musical Instruments: Control And Interaction Beyond the Keyboard (Computer Music and Digital Audio Series) , 2006 .

[17]  Matthew Wright,et al.  Problems and prospects for intimate musical control of computers , 2001 .

[18]  Lars Erik Holmquist.  Ubiquitous music , 2005, INTR.

[19]  Jef Raskin.  Intuitive equals familiar , 1994 .

[20]  Yu Nishibori,et al.  TENORI-ON , 2005, SIGGRAPH '05.

[21]  Dan Petrovic,et al.  Roland TR-808 Rhythm Composer , 2010 .

[22]  Max Jacobson,et al.  A Pattern Language: Towns, Buildings, Construction , 1981 .

[23]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[24]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[25]  Kim Halskov,et al.  The usability of everyday technology: emerging and fading opportunities , 2002, TCHI.

[26]  Bonnie Lee Appleton.  Patterns and Software: Essential Concepts and Terminology , 1997 .

[27]  Marcelo Soares Pimenta,et al.  Musical interaction patterns: communicating computer music knowledge in a multidisciplinary project , 2010, SIGDOC '10.

[28]  Michael Rohs,et al.  Interactivity for Mobile Music-Making , 2009, Organised Sound.