Towards a Virtual Reality Interface for Remote Robotic Teleoperation

Intuitive interaction is the cornerstone of efficient and effective task execution in remote robotic teleoperation. It requires high-fidelity in control actions as well as perception (vision, haptic, and sensory feedback) from the remote environment. This paper presents Vicarios, a VR-based teleoperation interface with the aim of facilitating intuitive real-time remote teleoperation, while utilizing the inherent benefits of VR, including immersive visualization, freedom of viewpoint selection, and fluidity of interaction through natural action interfaces. The overall architecture of Vicarios is described, with its components and framework. A preliminary comparative user study, with a real-world tele-manipulation task, was conducted to quantify the effectiveness of Vicarios. It is shown that the VR-based interface is easy-to-use and learn, with an overall learning rate of 0.93 sec. per trial for the users. The smoothness metric shows that the users can improve on their task performance over time as well. Vicarios allows the intuitiveness and flexibility to maintain efficiency in tele-robotic tasks. It forms the basis for an immersive perception interface in remote robotic teleoperation.

[1]  S. Buss Introduction to Inverse Kinematics with Jacobian Transpose , Pseudoinverse and Damped Least Squares methods , 2004 .

[2]  Manuel G. Catalano,et al.  Adaptive synergies for the design and control of the Pisa/IIT SoftHand , 2014, Int. J. Robotics Res..

[3]  Antonio Bicchi,et al.  Modelling natural and artificial hands with synergies , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[4]  Frank Steinicke,et al.  PROTOTYPING OF IMMERSIVE HRI SCENARIOS , 2017 .

[5]  A. K. Bejczy Virtual reality in robotics , 1996, Proceedings 1996 IEEE Conference on Emerging Technologies and Factory Automation. ETFA '96.

[6]  Fillia Makedon,et al.  VARM: Using Virtual Reality to Program Robotic Manipulators , 2017, PETRA.

[7]  Jessie Y. C. Chen,et al.  Human Performance Issues and User Interface Design for Teleoperated Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  David Whitney,et al.  ROS Reality: A Virtual Reality Framework Using Consumer-Grade Hardware for ROS-Enabled Robots , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Paul Milgram,et al.  Real World Teleoperation via Virtual Environment Modelling , 1997 .

[10]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[11]  Daniela Rus,et al.  Baxter's Homunculus: Virtual Reality Spaces for Teleoperation in Manufacturing , 2017, IEEE Robotics and Automation Letters.

[12]  Carlo Alberto Avizzano,et al.  Immersive ROS-integrated framework for robot teleoperation , 2015, 2015 IEEE Symposium on 3D User Interfaces (3DUI).

[13]  Odest Chadwicke Jenkins,et al.  Rosbridge: ROS for Non-ROS Users , 2011, ISRR.

[14]  Brian Coltin,et al.  HTC Vive: Analysis and Accuracy Improvement , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  William R. Hamel,et al.  Robotics in Hazardous Applications , 2008, Springer Handbook of Robotics, 2nd Ed..