Understanding human-robot interaction in virtual reality

Interactions with simulated robots are typically presented on screens. Virtual reality (VR) offers an attractive alternative as it provides visual cues that are more similar to the real world. In this paper, we explore how virtual reality mediates human-robot interactions through two user studies. The first study shows that in situations where perception of the robot is challenging, a VR display provides significantly improved performance on a collaborative task. The second study shows that this improved performance is primarily due to stereo cues. Together, the findings of these studies suggest that VR displays can offer users unique perceptual benefits in simulated robotics applications.

[1]  Gordon Clapworthy,et al.  Virtual reality tools for Internet robotics , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[2]  Grigore C. Burdea,et al.  Invited review: the synergy between virtual reality and robotics , 1999, IEEE Trans. Robotics Autom..

[3]  Bilge Mutlu,et al.  Evaluating intent-expressive robot arm motion , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[4]  Eric Kolstad,et al.  The Effects of Virtual Reality, Augmented Reality, and Motion Parallax on Egocentric Depth Perception , 2008, VR.

[5]  Julie M. Harris,et al.  Stereoscopic perception of real depths at large distances. , 2010, Journal of vision.

[6]  Bilge Mutlu,et al.  Communicating Directionality in Flying Robots , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  James Everett Young,et al.  Poor Thing! Would You Feel Sorry for a Simulated Robot? A comparison of empathy toward a physical and a simulated robot , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  Will Spijkers,et al.  Depth Perception in Virtual Reality: Distance Estimations in Peri- and Extrapersonal Space , 2008, Cyberpsychology Behav. Soc. Netw..

[9]  Mel Slater,et al.  Simulating virtual environments within virtual environments as the basis for a psychophysics of presence , 2010, SIGGRAPH 2010.

[10]  Susan R. Fussell,et al.  Anthropomorphic Interactions with a Robot and Robot–like Agent , 2008 .

[11]  R. Safaric,et al.  Control of robot arm with virtual environment via the Internet , 2003, Proc. IEEE.

[12]  Joseph J. LaViola,et al.  Evaluating performance benefits of head tracking in modern video games , 2013, SUI '13.

[13]  Dennis Proffitt,et al.  Quantifying immersion in virtual reality , 1997, SIGGRAPH.

[14]  K Simons,et al.  A comparison of the Frisby, Random-Dot E, TNO, and Randot circles stereotests in screening and office use. , 1981, Archives of ophthalmology.

[15]  Haruhisa Kawasaki,et al.  Virtual Teaching Based on Hand Manipulability for Multi-Fingered Robots , 2003 .

[16]  Eric D. Ragan,et al.  Studying the Effects of Stereo, Head Tracking, and Field of Regard on a Small-Scale Spatial Judgment Task , 2013, IEEE Transactions on Visualization and Computer Graphics.

[17]  Woodrow Barfield,et al.  Effects of Stereopsis and Head Tracking on Performance Using Desktop Virtual Environment Displays , 1999, Presence: Teleoperators & Virtual Environments.

[18]  A. Nowacki,et al.  Understanding Equivalence and Noninferiority Testing , 2011, Journal of General Internal Medicine.

[19]  Maja J. Mataric,et al.  Embodiment and Human-Robot Interaction: A Task-Based Perspective , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[20]  Hironao Yamada,et al.  Tele-operation Construction Robot Control System with Virtual Reality Technology , 2011 .

[21]  Brian Scassellati,et al.  The Benefits of Interactions with Physically Present Robots over Video-Displayed Agents , 2011, Int. J. Soc. Robotics.

[22]  K. Dautenhahn,et al.  Comparing human robot interaction scenarios using live and video based methods: towards a novel methodological approach , 2006, 9th IEEE International Workshop on Advanced Motion Control, 2006..