Touch Media: Investigating the Effects of Remote Touch on Music-based Emotion Elicitation

Touch is a contextual medium for affect conveyance. It is difficult to assign specific meanings to each instance of touch in isolation. However, when engaged within context, touch becomes a powerful and indispensable means for humans to convey feelings of love, concern, and sympathy. This paper explores how remote touch may influence one's affective experience of music, and how this experience is dependent on the relationship between the originator and recipient of the touch. For our study, we designed: (1) A mediated touch system that provides kinesthetic touches through an armband device that is controlled by changes in force applied to an input device, and (2) A touch-media system by which one can record and playback a co-temporal stream of touches with a track of music. We examined: (1) How remote touch may influence a touch recipient's experience of the music, and (2) how the recipients' affective experiences may depend on whether the touch is believed to be generated by intimates (familiar touch) versus by a music performer as part of a performance (unfamiliar touch)? Our study's results revealed that there is a significant correlation between the conditions (familiar, unfamiliar, and no touches) and song types (happy, sad) in both positive and negative affective experiences.

[1]  N. Henley,et al.  Body Politics: Power, Sex, and Nonverbal Communication , 1977 .

[2]  Leonardo Bonanni,et al.  Affective TouchCasting , 2006, SIGGRAPH '06.

[3]  Deborah I. Fels,et al.  The emoti-chair: an interactive tactile music exhibit , 2010, CHI Extended Abstracts.

[4]  P. Laukka,et al.  Expression, Perception, and Induction of Musical Emotions: A Review and a Questionnaire Study of Everyday Listening , 2004 .

[5]  S. Vrana,et al.  Some touching situations: The relationship between gender and contextual variables in cardiovascular responses to human touch , 1998, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[6]  M. Sile O'Modhrain,et al.  Cutaneous Grooves: Composing for the Sense of Touch , 2002 .

[7]  M. Belgrave,et al.  The effect of expressive and instrumental touch on the behavior states of older adults with late-stage dementia of the Alzheimer's type and on music therapist's perceived rapport. , 2009, Journal of music therapy.

[8]  I. Peretz,et al.  Happy, sad, scary and peaceful musical excerpts for research on emotions , 2008 .

[9]  Patrik N. Juslin,et al.  Musical expression of emotions : Modeling listeners´ judgements of composed and performed features , 2010 .

[10]  Rongrong Wang,et al.  Touch & talk: contextualizing remote touch for affective interaction , 2010, TEI '10.

[11]  Beatrice Alenljung,et al.  Designing for a Wearable Affective Interface for the NAO Robot: A Study of Emotion Conveyance by Touch , 2018, Multimodal Technol. Interact..

[12]  Rongrong Wang,et al.  Design and evaluation of a wearable remote social touch device , 2010, ICMI-MLMI '10.

[13]  Rongrong Wang,et al.  Contextualizing Remote Touch for Affect Conveyance , 2012 .

[14]  Jodi Forlizzi,et al.  The Hug: an exploration of robotic form for intimate communication , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[15]  Takashi Yamauchi,et al.  Reading Emotion From Mouse Cursor Motions: Affective Computing Approach , 2018, Cogn. Sci..

[16]  K. Scherer.  Which Emotions Can be Induced by Music? What Are the Underlying Mechanisms? And How Can We Measure Them? , 2004 .

[17]  P. Juslin.  From everyday emotions to aesthetic emotions: towards a unified theory of musical emotions. , 2013, Physics of life reviews.

[18]  Frank N. Willis,et al.  Development of Tactile Patterns in Relation to Age, Sex, and Race. , 1975 .

[19]  Joel Brockner,et al.  Nonverbal intimacy, sex, and compliance: A field study , 1982 .

[20]  Melanie Booth-Butterfield,et al.  Reach out and Touch Someone: Analysis of Nonverbal Comforting Responses. , 1993 .

[21]  H. Harlow.  The Nature of Love , 1958 .

[22]  R. Spitz,et al.  Anaclitic depression; an inquiry into the genesis of psychiatric conditions in early childhood. , 1946, The Psychoanalytic study of the child.

[23]  Rongrong Wang,et al.  Keep in touch: channel, expectation and experience , 2012, CHI.

[24]  D. Dodd,et al.  Student Burnout as a Function of Personality, Social Support, and Workload , 2003 .

[25]  Daniel Harrison,et al.  Feelybean: communicating touch over distance , 2012, CHI EA '12.

[26]  Judith A. Hall,et al.  More "touching" observations: New insights on men, women, and interpersonal touch. , 1990 .

[27]  Vernon B. Mountcastle,et al.  The sensory hand : neural mechanisms of somatic sensation , 2005 .

[28]  P. Laukka,et al.  Communication of emotions in vocal expression and music performance: different channels, same code? , 2003, Psychological bulletin.

[29]  D. Stack,et al.  The Salience of Touch and Physical Contact During Infancy: Unraveling Some of the Mysteries of the Somesthetic Sense , 2007 .

[30]  Aduén Darriba Frederiks,et al.  Affective Touch at a Distance , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[31]  Tiffany M Field,et al.  Infants' preference for touch stimulation in face-to-face interactions , 1996 .

[32]  Suranga Nanayakkara,et al.  An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair , 2009, CHI.

[33]  Xilin Chen,et al.  International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction , 2010, ICMI 2010.

[34]  Deborah I. Fels,et al.  Designing a model human cochlea: issues and challenges in crossmodal audio-haptic displays , 2008, HAS '08.

[35]  Stanley E. Jones,et al.  A naturalistic study of the meanings of touch , 1985 .

[36]  J. Peck,et al.  It Just Feels Good: Customers’ Affective Response to Touch and Its Influence on Persuasion: , 2006 .

[37]  Kristina Höök,et al.  CHI '12 Extended Abstracts on Human Factors in Computing Systems , 2012, CHI 2012.

[38]  Deborah I. Fels,et al.  Modelling Perceptual Elements of Music in a Vibrotactile Display for Deaf Users: A Field Study , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[39]  N. Henley.  Status and sex: Some touching observations , 1973 .

[40]  C. Kleinke,et al.  Compliance to requests made by gazing and touching experimenters in field settings. , 1977 .