A Distributed Software Architecture for Collaborative Teleoperation based on a VR Platform and Web Application Interoperability

Augmented Reality and Virtual Reality can provide to a Human Operator (HO) a real help to complete complex tasks, such as robot teleoperation and cooperative teleassistance. Using appropriate augmentations, the HO can interact faster, safer and easier with the remote real world. In this paper, we present an extension of an existing distributed software and network architecture for collaborative teleoperation based on networked human-scaled mixed reality and mobile platform. The first teleoperation system was composed by a VR application and a Web application. However the 2 systems cannot be used together and it is impossible to control a distant robot simultaneously. Our goal is to update the teleoperation system to permit a heterogeneous collaborative teleoperation between the 2 platforms. An important feature of this interface is based on different Mobile platforms to control one or many robots.

[1]  E. Torres-Jara,et al.  Challenges for Robot Manipulation in Human Environments , 2006 .

[2]  Charles C. Kemp,et al.  Challenges for robot manipulation in human environments [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[3]  Shumin Zhai,et al.  Applications of augmented reality for human-robot communication , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[4]  Malik Mallem,et al.  Computer-assisted visual perception in teleoperated robotics , 1992, Robotica.

[5]  Samir Otmane,et al.  3D interaction technique to enhance telemanipulation tasks using virtual environment , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  J. Geoffrey Chase,et al.  Human-Robot Collaboration: A Literature Review and Augmented Reality Approach in Design , 2008 .

[7]  Glauco Augusto de Paula Caurin,et al.  Scara3D: 3-Dimensional HRI integrated to a distributed control architecture for remote and cooperative actuation , 2008, SAC '08.

[8]  M. Mallem,et al.  Distributed Software Architecture for Collaborative Teleoperation based on Networked Mixed Reality Platforms , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[9]  Samir Otmane,et al.  A New Interface for Collaborative Teleoperation , 2005 .

[10]  Pierre Boudoin,et al.  Towards multimodal human-robot interaction in large scale virtual environment , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[11]  M. Mallem,et al.  Creating 3D Interaction Technique empirical evaluation with the use of a knowledge database of interaction experiments , 2008, 2008 Conference on Human System Interactions.