Tactile stimulus is essential to increase motivation for touch interaction in virtual environment

This paper reports the effectiveness of a tactile stimulus in a virtual environment to increase people's motivations during a monotonous task by comparing a touch with only visual stimuli and another with both visual and tactile stimuli. Although touch interaction with robots showed various positive effects such as improved motivation, visual and haptic stimuli were not separated due to the form of the touch in physical environments. Virtual environments enable us to investigate such effects by separating the modality of touch: a visual-only-touch and a visual-tactile touch. We experimented in a virtual environment where participants did a monotonous task after experiencing either a visual-only-touch or a visual-tactile-touch by an agent to compare them in the context of motivation improvements and the perceived impressions. The experimental results showed that a visual-tactile touch significantly increases the motivations of the participants for monotonous tasks. On the other hand, their likability of the agents is not significantly changed by the touch modalities. GRAPHICAL ABSTRACT

[1]  Hiroshi Ishiguro,et al.  Does A Robot’s Touch Encourage Human Effort? , 2017, Int. J. Soc. Robotics.

[2]  Jeremy N. Bailenson,et al.  The Proteus Effect , 2009, Commun. Res..

[3]  Indira Thouvenin,et al.  Social Touch in Human-agent Interactions in an Immersive Virtual Environment , 2019, VISIGRAPP.

[4]  Michiteru Kitazaki,et al.  Pseudo Physical Contact and Communication in VRChat: A Study with Survey Method in Japanese Users , 2020, ICAT-EGVE.

[5]  Matthias Scheutz,et al.  Observing Robot Touch in Context: How Does Touch and Attitude Affect Perceptions of a Robot’s Social Qualities? , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[6]  Kazuaki Tanaka,et al.  Remote handshaking: touch enhances video-mediated social telepresence , 2014, CHI.

[7]  T. Field.  Touch for Socioemotional and Physical Well-Being: A Review. , 2010 .

[8]  Jan B. F. van Erp,et al.  Social Touch in Human–Robot Interaction: Robot-Initiated Touches can Induce Positive Responses without Extensive Prior Bonding , 2018, Int. J. Soc. Robotics.

[9]  Andy C. H. Lee,et al.  Visual cues and virtual touch: Role of visual stimuli and intersensory integration in cross-modal haptic illusions and the sense of presence. , 2002 .

[10]  P. Haggard,et al.  The rubber hand illusion: Sensitivity and reference frame for body ownership , 2007, Consciousness and Cognition.

[11]  Norihiro Hagita,et al.  Audio-Visual Stimuli Change not Only Robot’s Hug Impressions but Also Its Stress-Buffering Effects , 2021, Int. J. Soc. Robotics.

[12]  T. Kondo,et al.  Functional Connectivity Analysis of NIRS Data under Rubber Hand Illusion to Find a Biomarker of Sense of Ownership , 2016, Neural plasticity.

[13]  D. Scott Lind,et al.  Virtual Humans That Touch Back: Enhancing Nonverbal Communication with Virtual Humans through Bidirectional Touch , 2009, 2009 IEEE Virtual Reality Conference.

[14]  Designing Personas for Expressive Robots , 2021, ACM Transactions on Human-Robot Interaction.

[15]  J. Bailenson,et al.  Transformed Representation 1 RUNNING HEAD: TRANSFORMED REPRESENTATION The Proteus Effect: Implications of Transformed Digital Self-Representation on Online and Offline Behavior , 2008 .

[16]  Gijs Huisman,et al.  Social Touch Technology: A Survey of Haptic Technology for Social Touch , 2017, IEEE Transactions on Haptics.

[17]  P. Haggard,et al.  The rubber hand illusion revisited: visuotactile integration and self-attribution. , 2005, Journal of experimental psychology. Human perception and performance.

[18]  Takayuki Kanda,et al.  A Communication Robot in a Shopping Mall , 2010, IEEE Transactions on Robotics.

[19]  Mitsuhiko Kimoto,et al.  Effects of Touch Behaviors and Whispering Voices in Robot-Robot Interaction for Information Providing Tasks , 2020, 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

[20]  G. Essick,et al.  Psychophysical assessment of the affective components of non-painful touch. , 1999, Neuroreport.

[21]  Elizabeth A. Franz,et al.  The rubber hand illusion and its application to clinical neuroscience , 2011, Journal of Clinical Neuroscience.

[22]  Mitsuhiko Kimoto,et al.  Effects of Social Touch from an Agent in Virtual Space: Comparing Visual Stimuli and Virtual-Tactile Stimuli , 2020, 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

[23]  Chris Bevan,et al.  Shaking Hands and Cooperation in Tele-present Human-Robot Negotiation , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[24]  Seiji Yamada,et al.  Expressing Emotions Through Color, Sound, and Vibration with an Appearance-Constrained Social Robot , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[25]  Brooke C. Feeney,et al.  Keep in touch: The effects of imagined touch support on stress and exploration , 2016 .

[26]  M. Masuch,et al.  The Experience of Social Touch in Multi-User Virtual Reality , 2020, VRST.

[27]  Norihiro Hagita,et al.  Robot Reciprocation of Hugs Increases Both Interacting Times and Self-disclosures , 2020, International Journal of Social Robotics.

[28]  Atsushi Yamashita,et al.  Analysis of electromyography and skin conductance response during rubber hand illusion , 2013, 2013 IEEE Workshop on Advanced Robotics and its Social Impacts.

[29]  Takashi Minato,et al.  What Kinds of Robot's Touch Will Match Expressed Emotions? , 2020, IEEE Robotics and Automation Letters.

[30]  Aduén Darriba Frederiks,et al.  Touching Virtual Agents: Embodiment and Mind , 2013, eNTERFACE.

[31]  Hiroshi Ishiguro,et al.  Survey of Social Touch Interaction Between Humans and Robots , 2020, J. Robotics Mechatronics.

[32]  Seiji Yamada,et al.  Effects of Agent Appearance on Customer Buying Motivations on Online Shopping Sites , 2015, CHI Extended Abstracts.

[33]  Maria V. Sanchez-Vives,et al.  First Person Experience of Body Transfer in Virtual Reality , 2010, PloS one.

[34]  Makoto Wada,et al.  Salivary Oxytocin Concentration Associates with the Subjective Feeling of Body Ownership during the Rubber Hand Illusion , 2017, Front. Hum. Neurosci..

[35]  K. Takemura.  The Effect of Interpersonal Sentiments on Behavioral Intention of Helping Behavior Among Japanese Students , 1993 .

[36]  B. J. Fogg,et al.  Persuasive technology: using computers to change what we think and do , 2002, UBIQ.

[37]  Grzegorz Pochwatko,et al.  Being Touched by a Virtual Human.: Relationships Between Heart Rate, Gender, Social Status, and Compliance. , 2019, IVA.

[38]  Alexander Toet,et al.  Social Touch in Human–Computer Interaction , 2015, Front. Digit. Humanit..

[39]  Yvonne de Kort,et al.  Is This My Hand I See Before Me? The Rubber Hand Illusion in Reality, Virtual Reality, and Mixed Reality , 2006, PRESENCE: Teleoperators and Virtual Environments.

[40]  Katherine J. Kuchenbecker,et al.  How Does It Feel to Clap Hands with a Robot? , 2019, Int. J. Soc. Robotics.

[41]  Y. Kitamura,et al.  ZoomWalls: Dynamic Walls that Simulate Haptic Infrastructure for Room-scale VR World , 2020, UIST.

[42]  Dana Kulic,et al.  Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots , 2009, Int. J. Soc. Robotics.

[43]  Catherine Pelachaud,et al.  Conveying Emotions Through Device-Initiated Touch , 2020, IEEE Transactions on Affective Computing.

[44]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[45]  J. Bailenson,et al.  The Proteus Effect: The Effect of Transformed Self-Representation on Behavior , 2007 .

[46]  S. Levy-Tzedek,et al.  Touching the social robot PARO reduces pain perception and salivary oxytocin levels , 2020, Scientific Reports.

[47]  K. Hiraki,et al.  Rubber Hand Illusion under Delayed Visual Feedback , 2009, PloS one.

[48]  Ellen Yi-Luen Do,et al.  RoomShift: Room-scale Dynamic Haptics for VR with Furniture-moving Swarm Robots , 2020, CHI.

[49]  Frank Biocca,et al.  Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces, and Cross-Modal Sensory Illusions , 2001, Presence: Teleoperators & Virtual Environments.

[50]  Brian Scassellati,et al.  Social robots for education: A review , 2018, Science Robotics.

[51]  Masayuki Hara,et al.  Virtual reality alters cortical oscillations related to visuo-tactile integration during rubber hand illusion , 2021, Scientific Reports.

[52]  Takayuki Kanda,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 2 , 2022 .

[53]  Wijnand A. IJsselsteijn,et al.  The Virtual Midas Touch: Helping Behavior After a Mediated Social Touch , 2008, IEEE Transactions on Haptics.

[54]  Norihiro Hagita,et al.  A hug from a robot encourages prosocial behavior , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[55]  V. Ramachandran,et al.  Projecting sensations to external objects: evidence from skin conductance response , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.