Systematic Tele-operation with Augmented Reality Path Planned Navigation Cues in Cluttered Environments

A novel method of providing human operators with Augmented Reality (AR) cues for collision-free navigation of robot arms in cluttered environments is described. The cues are graphic objects that aid the operator to rotate and translate the end-effector of the robot along AR collision-free paths pre-computed by a probabilistic path planner. Manual control of robot arms is a common mode of tele-manipulation on the International Space Station (ISS). Limited depth perception of the remote robot's 3D worksite can result in collisions with severe consequences. This paper combines the qualities of a planning algorithm to search for ideal paths, and the benefits of augmented reality for enhanced visualization. Presenting spatial path information to the user in an intuitive manner results in collision-free robot navigation along with performance repeatability. We present findings from the implementation of such a system with human operators and show that the system is beneficial.

[1]  S R Ellis,et al.  Collision in Space , 2000, Ergonomics in design : the magazine of human factors applications.

[2]  Jessie Y. C. Chen,et al.  Human Performance Issues and User Interface Design for Teleoperated Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Lydia E. Kavraki,et al.  Probabilistic roadmaps for path planning in high-dimensional configuration spaces , 1996, IEEE Trans. Robotics Autom..

[4]  Blake Hannaford,et al.  Quantitative Evaluation of Perspective and Stereoscopic Displays in Three-Axis Manual Tracking Tasks , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  Won S. Kim,et al.  Three-dimensional tracking with misalignment between display and control axes , 1991 .