Cooperative control of visual displays for telemanipulation

Two cooperative control schemes for telerobot visual displays are addressed. In the first scheme, on-the-screen visual enhancements such as reference lines indicating the vertical height of the robot hand, a stick figure model of the robot hand, and its projection on the horizontal grid plane are constructed by the interactive cooperation between the human operator and the telerobotic system, and then superimposed on the video screen. Experimental results with a five-degree-of-freedom robot and a frame grabber indicate that superimposition of visual enhancements on the video screen greatly improves telemanipulation task performance. In the second scheme, the position and orientation of an object on video screens are determined interactively; these then assist the telerobotic system in executing the human operator's task-level commands autonomously.<<ETX>>

[1]  G. Schut.  On exact linear equations for the computation of the rotational elements of absolute orientation , 1960 .

[2]  Lawrence G. Roberts,et al.  Machine Perception of Three-Dimensional Solids , 1963, Outstanding Dissertations in the Computer Sciences.

[3]  Ivan E. Sutherland,et al.  Three-dimensional data input by tablet , 1974 .

[4]  A K Bejczy,et al.  Sensors, Controls, and Man-Machine Interface for Advanced Teleoperation , 1980, Science.

[5]  S R Ellis,et al.  The Effect of Perspective Geometry on Judged Direction in Spatial Information Instruments , 1986, Human factors.

[6]  M. Hebert,et al.  The Representation, Recognition, and Locating of 3-D Objects , 1986 .

[7]  Charles R. Dyer,et al.  Model-based recognition in robot vision , 1986, CSUR.

[8]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[9]  S R Ellis,et al.  Statistical Dependency in Visual Scanning , 1986, Human factors.

[10]  Bir Bhanu,et al.  CAD-based robot vision , 1987 .

[11]  Blake Hannaford,et al.  Quantitative Evaluation of Perspective and Stereoscopic Displays in Three-Axis Manual Tracking Tasks , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  Blake Hannaford,et al.  Telerobotics: Display, control, and communication problems , 1987, IEEE J. Robotics Autom..

[13]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Lawrence W. Stark,et al.  Visual enhancements in pick-and-place tasks: Human operators controlling a simulated cylindrical manipulator , 1987, IEEE Journal on Robotics and Automation.

[15]  Bir Bhanu,et al.  CAD-Based 3D Object Representation for Robot Vision , 1987, Computer.