Object Touch by a Humanoid Robot Avatar Induces Haptic Sensation in the Real Hand

Humanoid robot embodiment is a recently developed form of mediated embodiment. In 2 studies, we report and quantify a new haptic (touch) illusion during embodiment of a humanoid robot. Around 60% of the users in our studies reported haptic sensations in their real hand when they observed their robot avatar touching a curtain with its hand. Critically, our study shows for the first time that users can experience haptic sensations from a nonanthropomorphic embodied limb/agent with visual feedback alone (i.e. no haptic feedback provided). The results have important implications for the understanding of the cognitive processes governing mediated embodiment and the design of avatar scenarios.

[1]  J. Bailenson,et al.  Virtual Superheroes: Using Superpowers in Virtual Reality to Encourage Prosocial Behavior , 2013, PloS one.

[2]  Mel Slater,et al.  Human Tails: Ownership and Control of Extended Humanoid Avatars , 2013, IEEE Transactions on Visualization and Computer Graphics.

[3]  Hans-Jochen Heinze,et al.  Fooling your feelings: Artificially induced referred sensations are linked to a modulation of the primary somatosensory cortex , 2006, NeuroImage.

[4]  Abderrahmane Kheddar,et al.  Non-human Looking Robot Arms Induce Illusion of Embodiment , 2017, Int. J. Soc. Robotics.

[5]  Hal E. Hershfield,et al.  Increasing Saving Behavior Through Age-Progressed Renderings of the Future Self , 2011, JMR, Journal of marketing research.

[6]  Laurent Étienne,et al.  Feeling bumps and holes without a haptic interface: the perception of pseudo-haptic textures , 2004, CHI.

[7]  Mel Slater,et al.  Comparison of SSVEP BCI and Eye Tracking for Controlling a Humanoid Robot in a Social Environment , 2014, PRESENCE: Teleoperators and Virtual Environments.

[8]  Bernhard Nebel,et al.  The Effect of Anthropomorphism on Social Tele-Embodiment , 2012 .

[9]  Frank Biocca,et al.  Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces, and Cross-Modal Sensory Illusions , 2001, Presence: Teleoperators & Virtual Environments.

[10]  Arindam Dey,et al.  Burnar: Involuntary heat sensations in augmented reality , 2013, 2013 IEEE Virtual Reality (VR).

[11]  Abderrahmane Kheddar,et al.  The second me: Seeing the real body during humanoid robot embodiment produces an illusion of bi-location , 2016, Consciousness and Cognition.

[12]  Anatole Lécuyer,et al.  Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-Haptic Feedback , 2009, PRESENCE: Teleoperators and Virtual Environments.

[13]  Advanced Robotics and its Social Impacts, ARSO 2011, Menlo Park, CA, USA, October 2-4, 2011 , 2011, ARSO.

[14]  Olivier Stasse,et al.  A versatile Generalized Inverted Kinematics implementation for collaborative working humanoid robots: The Stack Of Tasks , 2009, ICAR.

[15]  Alexis Paljic,et al.  Evaluation of pseudo-haptic feedback for simulating torque: a comparison between isometric and elastic input devices , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[16]  Abderrahmane Kheddar,et al.  Teleoperation based on the hidden robot concept , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[17]  V. Groom,et al.  The influence of racial embodiment on racial bias in immersive virtual environments , 2009 .

[18]  Heinrich H. Bülthoff,et al.  A comparison of geometric- and regression-based mobile gaze-tracking , 2014, Front. Hum. Neurosci..

[19]  A. Rogowska,et al.  Categorization of Synaesthesia , 2011 .

[20]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[21]  Abderrahmane Kheddar,et al.  Embodiment of a humanoid robot is preserved during partial and delayed control , 2015, 2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO).

[22]  Mel Slater,et al.  The Sense of Embodiment in Virtual Reality , 2012, PRESENCE: Teleoperators and Virtual Environments.

[23]  Mel Slater,et al.  Grand Challenges in Virtual Environments , 2014, Front. Robot. AI.

[24]  G. Ganesh,et al.  The role of functionality in the body model for self-attribution , 2016, Neuroscience Research.

[25]  J. Bailenson,et al.  The Proteus Effect: The Effect of Transformed Self-Representation on Behavior , 2007 .

[26]  René F. Kizilcec,et al.  The Relationship between Virtual Self Similarity and Social Anxiety , 2014, Front. Hum. Neurosci..

[27]  Laura Aymerich-Franch,et al.  Can We Identify with a Block? Identification with Non-anthropomorphic Avatars in Virtual Reality Games , 2012 .

[28]  Jeremy N. Bailenson,et al.  Experiencing Nature: Embodying Animals in Immersive Virtual Environments Increases Inclusion of Nature in Self and Involvement With Nature , 2016, J. Comput. Mediat. Commun..

[29]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[30]  Tabitha C. Peck,et al.  Putting yourself in the skin of a black avatar reduces implicit racial bias , 2013, Consciousness and Cognition.

[31]  Trevor Archer,et al.  Anxiety, Affect, Self-Esteem, and Stress: Mediation and Moderation Effects on Depression , 2013, PloS one.

[32]  Andy C. H. Lee,et al.  Visual cues and virtual touch: Role of visual stimuli and intersensory integration in cross-modal haptic illusions and the sense of presence. , 2002 .

[33]  Abderrahmane Kheddar,et al.  Pseudo-haptic feedback: can isometric input devices simulate force feedback? , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[34]  Frank H. Durgin,et al.  Rubber Hands Feel the Touch of Light , 2007, Psychological science.

[35]  Maria V. Sanchez-Vives,et al.  Extending Body Space in Immersive Virtual Reality: A Very Long Arm Illusion , 2012, PloS one.

[36]  R. Osu,et al.  Feeling the force: Returning haptic signals influence effort inference during motor coordination , 2013, Scientific Reports.

[37]  Abderrahmane Kheddar,et al.  fMRI-Based Robotic Embodiment: Controlling a Humanoid Robot by Thought Using Real-Time fMRI , 2014, PRESENCE: Teleoperators and Virtual Environments.

[38]  W. IJsselsteijn,et al.  The effect of similarities in skin texture and hand shape on perceived ownership of a fake limb. , 2008, Body image.

[39]  Marjolein P. M. Kammers,et al.  What is embodiment? A psychometric approach , 2008, Cognition.

[40]  Jaron Lanier,et al.  Homuncular Flexibility in Virtual Reality , 2015, J. Comput. Mediat. Commun..

[41]  Darwin G. Caldwell,et al.  Touching Sharp Virtual Objects Produces a Haptic Illusion , 2011, HCI.

[42]  Abderrahmane Kheddar,et al.  An integrated framework for humanoid embodiment with a BCI , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[43]  Frank Biocca,et al.  The Cyborg's Dilemma: Progressive Embodiment in Virtual Environments , 2006, J. Comput. Mediat. Commun..

[44]  A. Kheddar,et al.  Forward modelling the rubber hand: illusion of ownership modifies motor-sensory predictions by the brain , 2016, Royal Society Open Science.

[45]  Mar González-Franco,et al.  The contribution of real-time mirror reflections of motor actions on virtual body ownership in an immersive virtual environment , 2010, 2010 IEEE Virtual Reality Conference (VR).

[46]  Maria V. Sanchez-Vives,et al.  Virtual Hand Illusion Induced by Visuomotor Correlations , 2010, PloS one.

[47]  Roberta L Klatzky,et al.  Haptic object perception: spatial dimensionality and relation to vision , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[48]  Simon Richir,et al.  Influence of control/display ratio on the perception of mass of manipulated objects in virtual environments , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[49]  Lynette A. Jones,et al.  Tactile and Haptic Illusions , 2011, IEEE Transactions on Haptics.