Teleprogramming: Toward Delay-Invariant Remote Manipulation

This paper addresses the problem of teleoperation in the presence of communication delays. Delays occur with earth-based teleoperation in space and with surface-based teleoperation undersea using untethered submersibles and acoustic communication links. The delay in obtaining position and force feedback from the remote slave arms makes direct teleoperation infeasible. We are proposing a control methodology, called teleprogramming, which draws on the experience in the development of supervisory control techniques and robotics over the last three decades and introduces a number of new ideas in operator-model interaction as well as the nature and content of the information being sent to the slave robot. A teleprogramming system allows the operator to kinesthetically, as well as visually, interact with a graphic simulation of the remote environment and to interactively, online teleprogram the remote manipulator through a sequence of elementary robot instructions. A key feature and contribution of this work is the fact that these instructions are generated automatically, in real time, based on the operator's interaction with the simulated environment. The slave robot executes these commands delayed in time and, should an error occur, allows the operator to specify the necessary corrective actions and continue with the task. We will in this paper introduce the overall teleprogramming control concept, describe its main components, and report on the preliminary results using our experimental teleprogramming system.

[1]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[2]  W R Ferrell Delayed Force Feedback1 , 1966, Human factors.

[3]  Russell L. Andersson Computer architectures for robot control: a comparison and a new processor delivering 20 real MFLOPS , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[4]  Forrest T Buzan Control of telemanipulators with time delay : a predictive operator aid with force feedback , 1989 .

[5]  David B. Cooper,et al.  On Optimally Combining Pieces of Information, with Application to Estimating 3-D Complex-Object Position from Range Data , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Won S. Kim,et al.  The phantom robot: predictive displays for teleoperation with time delay , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[7]  Lawrence W. Stark,et al.  Cooperative control in telerobotics , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[8]  Frederick P. Brooks,et al.  Force display performs better than visual display in a simple 6-D docking task , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[9]  Blake Hannaford,et al.  A design framework for teleoperators with kinesthetic feedback , 1989, IEEE Trans. Robotics Autom..

[10]  James Hampton Black Factorial study of remote manipulation with transmission of time delay. , 1971 .

[11]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1989 .

[12]  Tsuneo Yoshikawa,et al.  Bilateral control of master-slave manipulators for ideal kinesthetic coupling-formulation and experiment , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[13]  Richard P. Paul,et al.  Design of a Tool-Surrounding Compliant Instrumented Wrist , 1991 .

[14]  Blake Hannaford,et al.  Experimental and simulation studies of hard contact in force reflecting teleoperation , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[15]  T. L. Brooks,et al.  Telerobotic response requirements , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[16]  Norman I. Badler,et al.  JACK: a toolkit for manipulating articulated figures , 1988, UIST '88.

[17]  John J. Craig,et al.  Hybrid position/force control of manipulators , 1981 .

[18]  S. Sathiya Keerthi,et al.  A fast procedure for computing the distance between complex objects in three space , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[19]  Sargur N. Srihari,et al.  Representation of Three-Dimensional Digital Images , 1981, CSUR.

[20]  William R. Ferrell,et al.  Remote manipulation with transmission delay. , 1965 .

[21]  G. P. Starr Supervisory control of remote manipulation: A preliminary evaluation , 1981 .

[22]  Hiroshi Ishikawa,et al.  Specification and generation of a motion path for compliant motion , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[23]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.