Facilitating Creative Exploratory Search with Multiple Networked Audio Devices Using HappyBrackets

We present HappyBrackets, an audio-focused creative coding toolkit for deploying music programs to remote networked devices. It is designed to support efficient creative exploratory search in the context of the Internet of Things (IoT), where one or more devices must be configured, programmed and interact over a network, with applications in digital musical instruments, networked music performance and other digital experiences. Users can easily monitor and hack what multiple devices are doing on the fly, enhancing their ability to perform “exploratory search” in a creative workflow. We present two creative case studies using the system: the creation of a dance performance and the creation of a distributed musical installation. Analysing different activities within the production process, with a particular focus on the trade-off between more creative exploratory tasks and more standard configuring and problem-solving tasks, we show how the system supports creative exploratory search for multiple networked devices, and consider design principles that could advance this support.

[1]  Sam Ferguson,et al.  Creative Media + the Internet of Things = Media Multiplicities , 2017, Leonardo.

[2]  Kim Halskov,et al.  Designing urban media façades: cases and challenges , 2010, CHI.

[3]  Steve Benford,et al.  Designing for Exploratory Play with a Hackable Digital Musical Instrument , 2016, Conference on Designing Interactive Systems.

[4]  Stefano Squartini,et al.  Wireless Networked Music Performance , 2016 .

[5]  Anthony Rowe,et al.  Sound design for a system of 1000 distributed independent audio-visual devices , 2017, NIME.

[6]  Anthony Rowe,et al.  Networked Pixels: Strategies for Building Visual and Auditory Images with Distributed Independent Devices , 2017, Creativity & Cognition.

[7]  Marcelo M. Wanderley,et al.  Libmapper: (a library for connecting things) , 2013, CHI Extended Abstracts.

[8]  Ben Shneiderman,et al.  Creativity Support Tools: Report From a U.S. National Science Foundation Sponsored Workshop , 2006, Int. J. Hum. Comput. Interact..

[9]  Alan F. Blackwell,et al.  CHAPTER 5 – Notational Systems—The Cognitive Dimensions of Notations Framework , 2003 .

[10]  Ben Shneiderman,et al.  Design Principles for Tools to Support Creative Thinking , 2005 .

[11]  Thor Magnusson,et al.  Designing Constraints: Composing and Performing with Digital Musical Systems , 2010, Computer Music Journal.

[12]  A. Blackwell,et al.  Sintr: Experimenting with liveness at scale , 2016 .

[13]  D. Simonton Creativity and Discovery as Blind Variation: Campbell's (1960) BVSR Model after the Half-Century Mark , 2011 .

[14]  Carlo Fischione,et al.  Internet of Musical Things: Vision and Challenges , 2018, IEEE Access.

[15]  Oliver Bown,et al.  Distributed Interactive Audio Devices: Creative strategies and audience responses to novel musical interaction scenarios , 2015 .