Toward Virtual Reality-based Evaluation of Robot Navigation among People

This paper explores the use of Virtual Reality (VR) to study humanrobot interactions during navigation tasks by both immersing a user and a robot in a shared virtual spaces. VR combines the advantages of being safe (as robots and humans interacting by the means of VR but can physically be in remote places) and ecological (realistic environments are perceived by the robot and the human, and natural behaviors can be observed). Nevertheless, VR can introduce perceptual biases in the interaction and affect in some ways the observed behaviors, which can be problematic when used to acquire experimental data. In our case, not only human perception is concerned, but also the one of the robot which requires to be simulated to perceive the VR world. Thus, the contribution of this paper is twofold. It first provides a technical solution to perform human robot interactions in navigation tasks through VR: we describe how we combine motion tracking, VR devices, as well as robot sensors simulation algorithms to immerse together a human and a robot in a shared virtual space. We then assess a simple interaction task that we replicate in real and in virtual conditions to perform a first estimation of the importance of the biases introduced by the use of VR on both a Human and a robot. Our conclusions are in favor of using VR to study human-robot interactions, and we are developing directions for future work.

[1]  Vishnu K. Narayanan,et al.  Design of an immersive simulator for assisted power wheelchair driving , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[2]  M. Bühler,et al.  Circumvention of Pedestrians While Walking in Virtual and Physical Environments , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Julien Pettré,et al.  Effect of Virtual Human Gaze Behaviour During an Orthogonal Collision Avoidance Walking Task , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[4]  Germán Ros,et al.  CARLA: An Open Urban Driving Simulator , 2017, CoRL.

[5]  Bradford J McFadyen,et al.  Characteristics of personal space during obstacle circumvention in physical and virtual environments. , 2008, Gait & posture.

[6]  Aude Billard,et al.  Safety issues in human-robot interactions , 2013, 2013 IEEE International Conference on Robotics and Automation.

[7]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Rachid Alami,et al.  Human-aware robot navigation: A survey , 2013, Robotics Auton. Syst..

[9]  Olivier Gibaru,et al.  Virtual reality for improving safety and collaborative control of industrial robots , 2015, VRIC.

[10]  Joyce Fung,et al.  Dynamic clearance measure to evaluate locomotor and perceptuo-motor strategies used for obstacle circumvention in a virtual environment. , 2015, Human movement science.

[11]  Chenfanfu Jiang,et al.  A virtual reality platform for dynamic human-scene interaction , 2016, SIGGRAPH ASIA Virtual Reality meets Physical Reality.

[12]  Victoria Interrante,et al.  Assessing the Relevance of Eye Gaze Patterns During Collision Avoidance in Virtual Reality , 2017, ICAT-EGVE.

[13]  Thies Pfeiffer,et al.  Behavior Analysis of Human Locomotion in the Real World and Virtual Reality for the Manufacturing Industry , 2018, ACM Trans. Appl. Percept..

[14]  Will Spijkers,et al.  Depth Perception in Virtual Reality: Distance Estimations in Peri- and Extrapersonal Space , 2008, Cyberpsychology Behav. Soc. Netw..

[15]  Anne-Hélène Olivier,et al.  Walking with Virtual People: Evaluation of Locomotion Interfaces in Dynamic Environments , 2018, IEEE Transactions on Visualization and Computer Graphics.

[16]  Thierry Fraichard Motion Safety with People: an Open Problem , 2015 .

[17]  Max Q.-H. Meng,et al.  A human-friendly robot navigation algorithm using the risk-RRT approach , 2016, 2016 IEEE International Conference on Real-time Computing and Robotics (RCAR).

[18]  Joyce Fung,et al.  Virtual Reality-Based Navigation Task to Reveal Obstacle Avoidance Performance in Individuals With Visuospatial Neglect , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Maja J. Mataric,et al.  Embodiment and Human-Robot Interaction: A Task-Based Perspective , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[20]  Charles B. Owen,et al.  Review on cybersickness in applications and visual displays , 2016, Virtual Reality.

[21]  William H. Warren,et al.  Optic flow is used to control human walking , 2001, Nature Neuroscience.

[22]  Maud Marchal,et al.  Kinematic Evaluation of Virtual Walking Trajectories , 2013, IEEE Transactions on Visualization and Computer Graphics.

[23]  Vincent Padois,et al.  Tools for dynamics simulation of robots: a survey based on user feedback , 2014, ArXiv.

[24]  Antonis A. Argyros,et al.  Navigation assistance and guidance of older adults across complex public spaces: the DALi approach , 2015, Intell. Serv. Robotics.

[25]  Hajime Asama,et al.  Inevitable collision states — a step towards safer robots? , 2004, Adv. Robotics.

[26]  David B. Kaber,et al.  The Utility of a Virtual Reality Locomotion Interface for Studying Gait Behavior , 2007, Hum. Factors.

[27]  Brian F. Goldiez,et al.  Human-aware robot motion planning with velocity constraints , 2008, 2008 International Symposium on Collaborative Technologies and Systems.

[28]  Julien Pettré,et al.  Going Through, Going Around: A Study on Individual Avoidance of Groups , 2015, IEEE Transactions on Visualization and Computer Graphics.

[29]  Thierry Fraichard,et al.  Human-Robot Motion: Taking Human Attention into Account , 2018, IROS 2018.

[30]  E. Saltzman,et al.  Effects of optic flow speed and lateral flow asymmetry on locomotion in younger and older adults: a virtual reality study. , 2009, The journals of gerontology. Series B, Psychological sciences and social sciences.

[31]  H. Lilliefors On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown , 1967 .

[32]  Rodolphe Gelin,et al.  A Mass-Produced Sociable Humanoid Robot: Pepper: The First Machine of Its Kind , 2018, IEEE Robotics & Automation Magazine.

[33]  Jochen Wirtz,et al.  Brave new world: service robots in the frontline , 2018, Journal of Service Management.

[34]  Andreas Krause,et al.  Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation , 2015, Int. J. Robotics Res..

[35]  J. Hietanen,et al.  I'll Walk This Way: Eyes Reveal the Direction of Locomotion and Make Passersby Look and Go the Other Way , 2009, Psychological science.

[36]  M. Tarr,et al.  Virtual reality in behavioral neuroscience and beyond , 2002, Nature Neuroscience.

[37]  Philip W. Fink,et al.  Obstacle avoidance during walking in real and virtual environments , 2007, TAP.

[38]  A. Berthoz,et al.  Timing and distance characteristics of interpersonal coordination during locomotion , 2005, Neuroscience Letters.

[39]  Ross A. Knepper,et al.  Effects of Distinct Robot Navigation Strategies on Human Behavior in a Crowded Environment , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[40]  Dirk Helbing,et al.  Crowd behaviour during high-stress evacuations in an immersive virtual environment , 2016, Journal of The Royal Society Interface.

[41]  Li Rui,et al.  Comparing Human-Robot Proxemics between Virtual Reality and the Real World , 2018 .