Reach out and touch me: effects of four distinct haptic technologies on affective touch in virtual reality

Virtual reality presents an extraordinary platform for multimodal communication. Haptic technologies have been shown to provide an important contribution to this by facilitating co-presence and allowing affective communication. However, the findings of the affective influences rely on studies that have used myriad different types of haptic technology, making it likely that some forms of tactile feedback are more efficient in communicating emotions than others. To find out whether this is true and which haptic technologies are most effective, we measured user experience during a communication scenario featuring an affective agent and interpersonal touch in virtual reality. Interpersonal touch was simulated using two types of vibrotactile actuators and two types of force feedback mechanisms. Self-reports of subjective experience of the agent’s touch and emotions were obtained. The results revealed that, regardless of the agent’s expression, force feedback actuators were rated as more natural and resulted in greater emotional interdependence and a stronger sense of co-presence than vibrotactile touch.

[1]  Martin R. Gibbs,et al.  Hug over a distance , 2005, CHI Extended Abstracts.

[2]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[3]  Mary-Anne Williams,et al.  Social Robotics , 2012, Lecture Notes in Computer Science.

[4]  Stephen A. Brewster,et al.  Investigating the effectiveness of tactile feedback for mobile touchscreens , 2008, CHI.

[5]  Michiel M. Spapé,et al.  Distilling the underlying dimensions of tactile melodies , 2003 .

[6]  Gerrit C. van der Veer,et al.  CHI '05 Extended Abstracts on Human Factors in Computing Systems , 2005, CHI 2005.

[7]  D. Keltner,et al.  Touch communicates distinct emotions. , 2006, Emotion.

[8]  Antti Jylhä,et al.  A Wearable Multimodal Interface for Exploring Urban Points of Interest , 2015, ICMI.

[9]  Gabriel Robles-De-La-Torre,et al.  The importance of the sense of touch in virtual and real environments , 2006, IEEE MultiMedia.

[10]  Jeremy N. Bailenson,et al.  Virtual Interpersonal Touch: Expressing and Recognizing Emotions Through Haptic Devices , 2007, Hum. Comput. Interact..

[11]  Bruce Bowe The Face of Emotion , 1985 .

[12]  Kazuaki Tanaka,et al.  Remote handshaking: touch enhances video-mediated social telepresence , 2014, CHI.

[13]  Cynthia LeRouge,et al.  Developing multimodal intelligent affective interfaces for tele-home health care , 2003, Int. J. Hum. Comput. Stud..

[14]  P. Ekman,et al.  Measuring facial movement , 1976 .

[15]  Rongrong Wang,et al.  Design and evaluation of a wearable remote social touch device , 2010, ICMI-MLMI '10.

[16]  C. Spence,et al.  The science of interpersonal touch: An overview , 2010, Neuroscience & Biobehavioral Reviews.

[17]  D. Keltner,et al.  The communication of emotion via touch. , 2009, Emotion.

[18]  Jean-Claude Martin,et al.  Impact of Expressive Wrinkles on Perception of a Virtual Character's Facial Expressions of Emotions , 2009, IVA.

[19]  J. V. Erp Guidelines for the Use of Vibro-Tactile Displays in Human Computer Interaction , 2002 .

[20]  Bernhard Hommel,et al.  Intermodal event files: integrating features across vision, audition, taction, and action , 2008, Psychological research.

[21]  Hideo Mitsuhashi,et al.  Improving Shared Experiences by Haptic Telecommunication , 2011, 2011 International Conference on Biometrics and Kansei Engineering.

[22]  Matthew J. Hertenstein,et al.  Nonverbal channel use in communication of emotion: how may depend on why. , 2011, Emotion.

[23]  Eve E. Hoggan,et al.  The meaning of the virtual Midas touch: an ERP study in economic decision making. , 2015, Psychophysiology.

[24]  P. Ekman Facial expression and emotion. , 1993, The American psychologist.

[25]  John-John Cabibihan,et al.  Affective Tele-touch , 2012, ICSR.

[26]  Karun B. Shimoga,et al.  A survey of perceptual feedback issues in dexterous telemanipulation. II. Finger touch feedback , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[27]  Luciano Gamberini,et al.  Symbiotic Interaction: A Critical Definition and Comparison to other Human-Computer Paradigms , 2014, Symbiotic.

[28]  C. Sherrick A scale for rate of tactual vibration. , 1985, The Journal of the Acoustical Society of America.

[29]  Paul Richard,et al.  Does Touch Matter?: The Effects of Haptic Visualization on Human Performance, Behavior and Perception , 2014, Int. J. Hum. Comput. Interact..

[30]  Barbara Deml,et al.  Efficient Bimodal Haptic Weight Actuation , 2010, EuroHaptics.

[31]  Wijnand A. IJsselsteijn,et al.  Mediated social touch: a review of current research and future directions , 2006, Virtual Reality.

[32]  Karun B. Shimoga,et al.  A survey of perceptual feedback issues in dexterous telemanipulation. I. Finger force feedback , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[33]  Giulio Jacucci,et al.  Total Immersion: Designing for Affective Symbiosis in a Virtual Reality Game with Haptics, Biosensors, and Emotive Agents , 2016, Symbiotic.

[34]  Eve E. Hoggan,et al.  Pressages: augmenting phone calls with non-verbal messages , 2012, UIST '12.

[35]  Wijnand A. IJsselsteijn,et al.  The Virtual Midas Touch: Helping Behavior After a Mediated Social Touch , 2008, IEEE Transactions on Haptics.