Musicians' initial encounters with a smart guitar

This paper presents a case study of a fully working prototype of the Sensus smart guitar. Eleven professional guitar players were interviewed after a prototype test session. The smartness of the guitar was perceived as enabling the integration of a range of equipment into a single device, and the proactive exploration of novel expressions. The results draw attention to the musicians' sense-making of the smart qualities, and to the perceived impact on their artistic practices. The themes highlight how smartness was experienced in relation to the guitar's agency and the skills it requires, the tension between explicit (e.g. playing a string) and implicit (e.g. keeping rhythm) body movements, and to performing and producing music. Understanding this felt sense of smartness is relevant to how contemporary HCI research conceptualizes mundane artefacts enhanced with smart technologies, and to how such discourse can inform related design issues.

[1]  S. Puig Digital lutherie - crafting musical computers for new musics' performance and improvisation , 2005 .

[2]  Barry A. T. Brown,et al.  Into the wild: challenges and opportunities for field trial methods , 2011, CHI.

[3]  Peter C. Wright,et al.  Designing Future Ubiquitous Homes with OUI Interiors: Possibilities and Challenges , 2017, IxD&A.

[4]  Alan Bryman,et al.  Analyzing Qualitative Data , 1994 .

[5]  Aude Billard,et al.  Roombots: Reconfigurable Robots for Adaptive Furniture , 2010, IEEE Computational Intelligence Magazine.

[6]  Steve Benford,et al.  Designing the spectator experience , 2005, CHI.

[7]  Yongmeng Wu,et al.  A Participatory Live Music Performance with the Open Symphony System , 2016, CHI Extended Abstracts.

[8]  Marcelo M. Wanderley,et al.  New Digital Musical Instruments: Control And Interaction Beyond the Keyboard (Computer Music and Digital Audio Series) , 2006 .

[9]  Patrick Olivier,et al.  Waves: multi-touch VJ interface , 2010, ITS '10.

[10]  Rainer Malaka,et al.  An unfinished drama: designing participation for the theatrical dance performance Parcival XX-XI , 2012, DIS '12.

[11]  Bågander Linnea,et al.  Body of movement , 2018 .

[12]  Steve Benford,et al.  Augmenting a guitar with its digital footprint , 2015, NIME.

[13]  Sergi Jordà,et al.  Sonigraphical Instruments: From FMOL to the reacTable* , 2003, NIME.

[14]  Ludvig Elblaus,et al.  Singing Interaction: Embodied Instruments for Musical Expression in Opera , 2014, Leonardo Music Journal.

[15]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[16]  Susanne Bødker,et al.  When second wave HCI meets third wave challenges , 2006, NordiCHI '06.

[17]  Steve Benford,et al.  Designing for Exploratory Play with a Hackable Digital Musical Instrument , 2016, Conference on Designing Interactive Systems.

[18]  Simon Holland,et al.  Music and Human-Computer Interaction , 2013, Springer Series on Cultural Computing.

[19]  Stefan Rennick Egglestone,et al.  Crafting Interactive Decoration , 2017, ACM Trans. Comput. Hum. Interact..

[20]  Patrick Olivier,et al.  Designing from within: humanaquarium , 2011, CHI.

[21]  Peter C. Wright,et al.  Experience-Centered Design: Designers, Users, and Communities in Dialogue , 2010, Experience-Centered Design.

[22]  Sergi Jordà,et al.  Digital Instruments and Players: Part I - Efficiency and Apprenticeship , 2004, NIME.

[23]  Michel Beaudouin-Lafon,et al.  Instrumental interaction: an interaction model for designing post-WIMP user interfaces , 2000, CHI.

[24]  Chiara Rossitto,et al.  Understanding audience participation in an interactive theater performance , 2014, NordiCHI.

[25]  Rob Kling,et al.  Computerization and controversy (2nd ed.): value conflicts and social choices , 1995 .

[26]  Jakob Tholander,et al.  Setting the stage - Embodied and spatial dimensions in emerging programming practices , 2009, Interact. Comput..

[27]  Brendan Walker,et al.  Performing Research: Four Contributions to HCI , 2017, CHI.

[28]  Elisa Giaccardi,et al.  Co-performance: Conceptualizing the Role of Artificial Agency in the Design of Everyday Life , 2018, CHI.

[29]  JOHN F. Young Machine Intelligence , 1971, Nature.

[30]  Oskar Juhlin,et al.  Enjoying machines , 2015 .

[31]  R.I.A. Mercuri,et al.  Technology as Experience , 2005, IEEE Transactions on Professional Communication.

[32]  T. Ingold Walking the Plank: Meditations on a Process of Skill , 2006 .

[33]  Kristina Höök,et al.  The IKEA Catalogue: Design Fiction in Academic and Industrial Collaborations , 2016, GROUP.

[34]  Richard Parncutt,et al.  The Science & Psychology of Music Performance , 2002 .

[35]  Jakob Tholander,et al.  Revisiting the jacquard loom: threads of history and current patterns in HCI , 2012, CHI.

[36]  Paul Dourish,et al.  Where the action is , 2001 .

[37]  Ellen Campana,et al.  Amateur Musicians, Long-Term Engagement, and HCI , 2013, Music and Human-Computer Interaction.

[38]  William W. Gaver,et al.  Developing the drift table , 2006, INTR.

[39]  Chiara Rossitto,et al.  Acting with Technology: Rehearsing for Mixed-Media Live Performances , 2016, CHI.

[40]  Steve Benford,et al.  Building a Maker Community Around an Open Hardware Platform , 2017, CHI.

[41]  Chen Wang,et al.  Distributed Liveness: Understanding How New Technologies Transform Performance Experiences , 2016, CSCW.

[42]  Steve Benford,et al.  Accountable Artefacts: The Case of the Carolan Guitar , 2016, CHI.

[43]  Andy Crabtree,et al.  Design in the absence of practice: breaching experiments , 2004, DIS '04.

[44]  Fabio Morreale,et al.  Design for longevity: ongoing use of instruments from nime 2010-14 , 2017, NIME.

[45]  Chiara Rossitto,et al.  Interweaving place and story in a location-based audio drama , 2016, Personal and Ubiquitous Computing.

[46]  Chiara Rossitto,et al.  Bio-Sensed and Embodied Participation in Interactive Performance , 2017, TEI.

[47]  Jodi Forlizzi,et al.  Service robots in the domestic environment: a study of the roomba vacuum in the home , 2006, HRI '06.

[48]  Kristina Höök,et al.  The vocal chorder: empowering opera singers with a large interactive instrument , 2014, CHI.

[49]  Steve Benford,et al.  Performing Mixed Reality , 2011 .

[50]  Chiara Rossitto,et al.  Understanding agency in interaction design materials , 2012, CHI.

[51]  Jakob Tholander,et al.  MoBoogie: creative expression through whole body musical interaction , 2011, CHI.

[52]  R. Kling Computerization and Controversy , 1997 .

[53]  Carlo Fischione,et al.  Smart instruments : Towards an ecosystem of interoperable devices connecting performers and audiences , 2019 .

[54]  Ron Wakkary,et al.  Morse Things: A Design Inquiry into the Gap Between Things and Us , 2017, Conference on Designing Interactive Systems.