How to Touch Humans: Guidelines for Social Agents and Robots That Can Touch

Touch is an essential channel in interpersonal and affective communication, yet most social agents currently lack the capability to touch the user. In this paper we show the credibility of three premises that make the case that providing touch capability to social robots will increase their effectiveness in communicating emotions, building trust and achieving behavioral changes. The first premise is that humans can communicate distinct emotions through touch only, the second is that this is also possible through mediated (virtual) touch, and the third is that social agents can use the same mediated touch technology as effectively as humans. Based on a literature review, we also formulate ten design rules as guidance for the development of social agents that can touch. These rules concern parameters that regulate the meaning of touch cues like context and familiarity, the implicit and explicit meanings of touch, user characteristics, and parameters that can be communicated through affective touch.

[1]  W. Roth,et al.  Social anxiety and response to touch: incongruence between self-evaluative and physiological reactions , 2001, Biological Psychology.

[2]  Cynthia Breazeal,et al.  Social robots for health applications , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Abu Saleh Md. Mahfujur Rahman,et al.  Measurements of Multimodal Approach to Haptic Interaction in Second Life Interpersonal Communication System , 2011, IEEE Transactions on Instrumentation and Measurement.

[4]  Pamela J. Hinds,et al.  Who Should I Blame? Effects of Autonomy and Transparency on Attributions in Human-Robot Interaction , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[5]  Stanley E. Jones,et al.  A naturalistic study of the meanings of touch , 1985 .

[6]  Wijnand A. IJsselsteijn,et al.  Mediated social touch: a review of current research and future directions , 2006, Virtual Reality.

[7]  Malin Björnsdotter,et al.  Vicarious Responses to Social Touch in Posterior Insular Cortex Are Tuned to Pleasant Caressing Speeds , 2011, The Journal of Neuroscience.

[8]  C. Kleinke,et al.  Compliance to requests made by gazing and touching experimenters in field settings. , 1977 .

[9]  Wijnand A. IJsselsteijn,et al.  The Virtual Midas Touch: Helping Behavior After a Mediated Social Touch , 2009, IEEE Trans. Haptics.

[10]  H. Harlow,et al.  Affectional responses in the infant monkey; orphaned baby monkeys develop a strong and persistent attachment to inanimate surrogate mothers. , 1959, Science.

[11]  Kenton O'Hara,et al.  Social Impact , 2019, Encyclopedia of Food and Agricultural Ethics.

[12]  Dzmitry Tsetserukou,et al.  Innovative Real-Time Communication System with Rich Emotional and Haptic Channels , 2010, EuroHaptics.

[13]  James E Phelan,et al.  Exploring the use of touch in the psychotherapeutic setting: A phenomenological review. , 2009, Psychotherapy.

[14]  J. V. Erp.  Guidelines for the Use of Vibro-Tactile Displays in Human Computer Interaction , 2002 .

[15]  E. Bush,et al.  The Use of Human Touch to Improve the Well-Being of Older Adults , 2001, Journal of holistic nursing : official journal of the American Holistic Nurses' Association.

[16]  Stephen A. Brewster,et al.  Setting the Standards for Haptic and Tactile Interactions: ISO's Work , 2010, EuroHaptics.

[17]  J. Hampton,et al.  The effect of relationship status on communicating emotions through touch , 2011, Cognition & emotion.

[18]  Michael W. Kraus,et al.  Tactile communication, cooperation, and performance: an ethological study of the NBA. , 2010, Emotion.

[19]  Benjamin Lok,et al.  Virtual Human + Tangible Interface = Mixed Reality Human An Initial Exploration with a Virtual Breast Exam Patient , 2008, 2008 IEEE Virtual Reality Conference.

[20]  Ho-Joon Lee,et al.  A ubiquitous Smart Parenting and Customized Education service robot , 2010, 2010 IEEE Workshop on Advanced Robotics and its Social Impacts.

[21]  Dacher Keltner,et al.  Gender and the Communication of Emotion Via Touch , 2010, Sex roles.

[22]  Roope Raisamo,et al.  The Role of Gesture Types and Spatial Feedback in Haptic Communication , 2011, IEEE Transactions on Haptics.

[23]  Rongrong Wang,et al.  Touch & talk: contextualizing remote touch for affective interaction , 2010, TEI '10.

[24]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[25]  F. N. Willis,et al.  The use of interpersonal touch in securing compliance , 1980 .

[26]  Abu Saleh Md. Mahfujur Rahman,et al.  HKiss: Real world based haptic interaction with virtual 3D avatars , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[27]  Timothy W. Bickmore,et al.  Establishing and maintaining long-term human-computer relationships , 2005, TCHI.

[28]  Karon E. MacLean,et al.  Communicating emotion through a haptic link: Design space and methodology , 2007, Int. J. Hum. Comput. Stud..

[29]  C. Spence,et al.  The science of interpersonal touch: An overview , 2010, Neuroscience & Biobehavioral Reviews.

[30]  Melanie Booth-Butterfield,et al.  Reach out and Touch Someone: Analysis of Nonverbal Comforting Responses. , 1993 .

[31]  Vanessa Evers,et al.  The Evaluation of Empathy, Autonomy and Touch to Inform the Design of an Environmental Monitoring Robot , 2010, ICSR.

[32]  Henrik Schärfe,et al.  Initial Formation of Trust: Designing an Interaction with Geminoid-DK to Promote a Positive Attitude for Cooperation , 2011, ICSR.

[33]  Hendrik A. H. C. van Veen,et al.  Waypoint navigation with a vibrotactile waist belt , 2005, TAP.

[34]  D. Keltner,et al.  The communication of emotion via touch. , 2009, Emotion.

[35]  Andrea Lockerd Thomaz,et al.  Touched by a robot: An investigation of subjective responses to robot-initiated touch , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[36]  Francis McGlone,et al.  The development and validation of sensory and emotional scales of touch perception , 2011, Attention, perception & psychophysics.

[37]  Maria Henricson,et al.  The outcome of tactile touch on stress parameters in intensive care: a randomized controlled trial. , 2008, Complementary therapies in clinical practice.

[38]  Fiona Timmins,et al.  A review of the use and clinical effectiveness of touch as a nursing intervention , 2005 .

[39]  Matthew J. Hertenstein,et al.  Nonverbal channel use in communication of emotion: how may depend on why. , 2011, Emotion.

[40]  Hideo Mitsuhashi,et al.  Improving Shared Experiences by Haptic Telecommunication , 2011, 2011 International Conference on Biometrics and Kansei Engineering.

[41]  S. O. Chang,et al.  The conceptual structure of physical touch in caring. , 2001, Journal of advanced nursing.

[42]  A. Cranny-Francis.  Semefulness: a social semiotics of touch , 2011 .

[43]  Ryan S. Elder,et al.  Feminine to smell but masculine to touch? Multisensory congruence and its effect on the aesthetic experience , 2010 .

[44]  Hiroshi Ishiguro,et al.  Effect of robot's active touch on people's motivation , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[45]  J. Bailenson,et al.  Virtual Interpersonal Touch and Digital Chameleons , 2007 .

[46]  Roope Raisamo,et al.  Emotional and behavioral responses to haptic stimulation , 2008, CHI.

[47]  David C F Vaidis,et al.  Increasing Compliance with a Request: Two Touches are More Effective than One , 2008, Psychological reports.

[48]  C. Wetzel,et al.  The Midas Touch , 1984 .

[49]  Shafiq ur Réhman,et al.  iFeeling: Vibrotactile Rendering of Human Emotions on Mobile Phones , 2008, WMMP.

[50]  J. Wessberg,et al.  Pleasantness of touch in human glabrous and hairy skin: Order effects on affective ratings , 2011, Brain Research.

[51]  Karon E. MacLean,et al.  Hapticat: exploration of affective touch , 2005, ICMI '05.

[52]  Adeline Deladisma,et al.  Mixed Reality Humans: Evaluating Behavior, Usability, and Acceptability , 2009, IEEE Transactions on Visualization and Computer Graphics.

[53]  Wa Wijnand IJsselsteijn,et al.  Combining mediated social touch with vision : from self-attribution to telepresence? , 2010 .

[54]  Shuo Wang,et al.  Squeeze me, but don't tease me: Human and mechanical touch enhance visual attention and emotion discrimination , 2011, Social neuroscience.

[55]  Jeroen Stouten,et al.  A situational touch: How touch affects people's decision behavior , 2013 .

[56]  Timothy W. Bickmore,et al.  Empathic Touch by Relational Agents , 2010, IEEE Transactions on Affective Computing.

[57]  John-John Cabibihan,et al.  Affective Tele-touch , 2012, ICSR.

[58]  Roope Raisamo,et al.  Touch gestures in communicating emotional intention via vibrotactile stimulation , 2013, Int. J. Hum. Comput. Stud..

[59]  Daut Daman,et al.  Haptic Vibration for Emotional Expression of Avatar to Enhance the Realism of Virtual Reality , 2009, 2009 International Conference on Computer Technology and Development.

[60]  J.B.F. van Erp,et al.  Guidelines for the use of vibro-tactile displays in human computer interaction , 2002 .

[61]  T. Field.  Touch for Socioemotional and Physical Well-Being: A Review. , 2010 .

[62]  J. V. Erp,et al.  Vibrotactile in-vehicle navigation system , 2004 .

[63]  R. Heslin,et al.  The meanings of touch: sex differences. , 1975, The Journal of communication.

[64]  Wijnand A. IJsselsteijn,et al.  The Virtual Midas Touch: Helping Behavior After a Mediated Social Touch , 2008, IEEE Transactions on Haptics.

[65]  Nicolas Guéguen,et al.  Tactile Contact and Spontaneous Help: An Evaluation in a Natural Setting , 2003, The Journal of social psychology.

[66]  Jeremy N. Bailenson,et al.  Virtual Interpersonal Touch: Expressing and Recognizing Emotions Through Haptic Devices , 2007, Hum. Comput. Interact..

[67]  A. Bruce.  Emotional Expression , 1883, The American Naturalist.

[68]  野間 春生,et al.  Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 参加報告 , 1997 .

[69]  Karon E. MacLean,et al.  The Role of Affective Touch in Human-Robot Interaction: Human Intent and Expectations in Touching the Haptic Creature , 2012, Int. J. Soc. Robotics.

[70]  M. Patterson,et al.  Touch, compliance, and interpersonal affect , 1986 .

[71]  Wa Wijnand IJsselsteijn,et al.  I'm always touched by your presence, dear : combining mediated social touch with morphologically correct visual feedback , 2009 .

[72]  R. Heslin,et al.  Hands touching hands: affective and evaluative effects of an interpersonal touch. , 1976, Sociometry.

[73]  Paul Lemmens,et al.  A body-conforming tactile jacket to enrich movie viewing , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[74]  Henriette Cramer,et al.  ‘Give me a hug’: the effects of touch and autonomy on people's responses to embodied social agents , 2009, Comput. Animat. Virtual Worlds.

[75]  Junseok Park,et al.  A Tactile Emotional Interface for Instant Messenger Chat , 2007, HCI.