ShEMP : A Mobile Framework for Shared Emotion , Music , and Physiology

As we continue to strive toward a deeper understanding of human social interaction, the playing field continues to change beneath our feet. Ever swiftly, in even the last decade, the means by which we interact, the frequency in which we do so, even the meaning of interaction within daily life continues to evolve as humans become connected in novel ways—one need only consider the “Twittersphere” or how text messages have come to largely replace paper letters or even email communication. Since 2010, partners in the Social Interaction and Entrainment using Music Performance Experimentation have been investigating the concepts of emotional contagion, leadership, entrainment, and co-creation, and how they support social interaction through a series of studies of music performance and listening. This paper introduces ShEMP, a mobile software framework for Shared Emotion, Music, and Physiology. ShEMP provides a new set of tools for use in the design and execution of experiments that take this investigation of human emotion and interaction further afield into shared music experiences that occur between groups connected via their mobile devices. Here, we provide an overview of the software framework and a description of a series of experiments that have motivated the development of ShEMP.

[1]  Javier Jaimovich,et al.  Emotion in Motion: A Study of Music and Affective Response , 2012, CMMR.

[2]  J. Cacioppo,et al.  Primitive emotional contagion. , 1992 .

[3]  Ge Wang,et al.  MoMu: A Mobile Music Toolkit , 2010, NIME.

[4]  Javier Jaimovich,et al.  Contagion of Physiological Correlates of Emotion between Performer and Audience: An Exploratory Study , 2010, B-Interface.

[5]  Ge Wang,et al.  Audience-Participation Techniques Based on Social Mobile Computing , 2011, ICMC.

[6]  Roy Fielding,et al.  Architectural Styles and the Design of Network-based Software Architectures"; Doctoral dissertation , 2000 .

[7]  R. Plutchik The psychology and biology of emotion , 1994 .

[8]  Yoshiyuki Miwa,et al.  Electromyography Focused on Passiveness and Activeness in Embodied Interaction: Toward a Novel Interface for Co-creating Expressive Body Movement , 2009, HCI.

[9]  Ge Wang World Stage: A Crowdsourcing Paradigm for Social Mobile Music , 2011 .

[10]  Brennon Bortz,et al.  MobileMuse: Integral Music Control Goes Mobile , 2011, NIME.

[11]  M Ericson,et al.  Heart rate variability in healthy subjects is related to age and gender. , 1997, Acta physiologica Scandinavica.

[12]  R. A. Mcfarland Relationship of skin temperature changes to the emotions accompanying music , 1985, Biofeedback and self-regulation.

[13]  W. Boucsein Electrodermal activity, 2nd ed. , 2012 .

[14]  Arthur C. Clarke,et al.  Designing Smule’s iPhone Ocarina , 2009 .

[15]  Udo Will,et al.  The concept of entrainment and its significance for ethnomusicology , 2004 .