A VR-Human Interface for Assisting Human Input in Path Planning for Telerobots

In telerobotic systems, human beings are required to provide input to the telerobot. It is very difficult to provide accurate and smooth input paths quickly through the master arm and avoid collisions. These problems are further compounded by time-delay when the distances involved are large (for example, in the case of space exploration). If an intermediate VR system can modify the human input to provide smooth, collision-free paths, the intuitive capabilities of human beings to identify a feasible path can be quickly combined with the machine's ability to modify the colliding segments to noncolliding ones. We call this synthesis shared intelligence. This paper develops the strategies and mathematics to implement this concept of shared intelligence in path planning, using a VR interface in which human and machine abilities are combined appropriately. Shared intelligence unburdens the human operator from precisely and accurately inputting the planned path. With the help of the free space developed for a simple telerobot, it is shown how the human input is converted into parameterized paths in the configuration space, checked for collisions, and automatically modified into collision-free paths using repulsive fields introduced in the configuration space. Simulations and experimental results are also shown to illustrate these concepts.

[1]  Blake Hannaford,et al.  Performance evaluation of a 6 axis high fidelity generalized force reflecting teleoperator , 1989 .

[2]  John H. Reif,et al.  Complexity of the mover's problem and generalizations , 1979, 20th Annual Symposium on Foundations of Computer Science (sfcs 1979).

[3]  Lawrence W. Stark,et al.  Model-Based Supervisory Control in Telerobotics , 1996, Presence: Teleoperators & Virtual Environments.

[4]  Bruno Buchberger,et al.  Computer algebra symbolic and algebraic computation , 1982, SIGS.

[5]  Lawrence Stark,et al.  The 3D model control of image processing , 1989 .

[6]  A K Bejczy,et al.  Sensors, Controls, and Man-Machine Interface for Advanced Teleoperation , 1980, Science.

[7]  Lawrence W. Stark,et al.  Some of what one needs to know about using head-mounted displays to improve teleoperator performance , 1993, IEEE Trans. Robotics Autom..

[8]  Antal K. Bejczy,et al.  Anthropomorphic Telemanipulation System in Terminus Control Mode , 1995 .

[9]  Susumu Tachi,et al.  Tele-existence master-slave system for remote manipulation , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[10]  Won S. Kim,et al.  The phantom robot: predictive displays for teleoperation with time delay , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[11]  Thomas B. Sheridan,et al.  Effects of predicted information in teleoperation with time delay , 1986 .

[12]  Richard A. Volz,et al.  Teleautonomous systems: projecting and coordinating intelligent action at a distance , 1990, IEEE Trans. Robotics Autom..

[13]  W. Ferrell,et al.  REMOTE MANIPULATION WITH TRANSMISSION DELAY. NASA TN D-2665. , 1965, NASA contractor report. NASA CR. United States. National Aeronautics and Space Administration.

[14]  Masaru Uchiyama,et al.  Shared intelligence for telerobots with time delay: theory and human interface with local intelligence , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[15]  Vladimir J. Lumelsky,et al.  On human performance in telerobotics , 1991, IEEE Trans. Syst. Man Cybern..

[16]  A. C. Bajpai,et al.  Numerical Methods for Engineers and Scientists. , 1978 .

[17]  Thomas B. Sheridan,et al.  Space teleoperation through time delay: review and prognosis , 1993, IEEE Trans. Robotics Autom..

[18]  Won S. Kim,et al.  Demonstration of a high-fidelity predictive/preview display technique for telerobotic servicing in space , 1993, IEEE Trans. Robotics Autom..

[19]  A. Bejczy,et al.  Graphics displays for operator aid in telemanipulation , 1991, Conference Proceedings 1991 IEEE International Conference on Systems, Man, and Cybernetics.

[20]  M. Uchiyama,et al.  Shared intelligence for telerobots: human interface with local intelligence , 1993, Proceedings of 1993 2nd IEEE International Workshop on Robot and Human Communication.

[21]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[22]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[23]  Lawrence W. Stark,et al.  A supervisory telerobotic control system using model-based vision feedback , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[24]  A. K. Bejczy,et al.  A laboratory breadboard system for dual-arm teleoperation , 1990 .

[25]  J. Hoffman Numerical Methods for Engineers and Scientists , 2018 .

[26]  Blake Hannaford,et al.  Telerobotics: Display, control, and communication problems , 1987, IEEE J. Robotics Autom..

[27]  Lawrence W. Stark,et al.  Instrumentation and robotic image processing using top-down model control , 1990 .

[28]  W. Greub Linear Algebra , 1981 .

[29]  Won S. Kim,et al.  Virtual Reality Calibration and Preview/Predictive Displays for Telerobotics , 1996, Presence: Teleoperators & Virtual Environments.

[30]  John Canny,et al.  The complexity of robot motion planning , 1988 .

[31]  Stephen R. Ellis,et al.  What are virtual environments? , 1994, IEEE Computer Graphics and Applications.