VISUAL CONTROL OF ROBOT MANIPULATORS – A REVIEW

This paper attempts to present a comprehensive summary of research results in the use of visual information to control robot manipulators and related mechanisms. An extensive bibliography is provided which also includes important papers from the elemental disciplines upon which visual servoing is based. The research results are discussed in terms of historical context, common-ality of function, algorithmic approach and method of implementation.

[1]  D. E. Whitney,et al.  The mathematics of coordinated control of prosthetic arms and manipulators. , 1972 .

[2]  Yoshiaki Shirai,et al.  Guiding a robot by visual feedback in assembling tasks , 1973, Pattern Recognit..

[3]  I. E. Sutherland,et al.  Three-dimensional data input by tablet , 1974, SIGGRAPH 1974.

[4]  Yoram Yakimovsky,et al.  A system for extracting three-dimensional measurements from a stereo pair of TV cameras , 1976 .

[5]  Ramakant Nevatia,et al.  Depth measurement by motion stereo , 1976 .

[6]  Robert C. Bolles,et al.  Verification Vision for Programmable Assembly , 1977, IJCAI.

[7]  Joan S. Weszka,et al.  A survey of threshold selection techniques , 1978 .

[8]  Michael K. Giles,et al.  A Real-Time Video Tracking System , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[10]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[11]  James S. Albus,et al.  Brains, behavior, and robotics , 1981 .

[12]  Robert B. Kelley,et al.  Camera Models Based on Data from Two Calibration Planes , 1981 .

[13]  R. Paul.  Robot manipulators : mathematics, programming, and control : the computer control of robot manipulators , 1981 .

[14]  R. Bolles,et al.  Recognizing and Locating Partially Visible Objects: The Local-Feature-Focus Method , 1982 .

[15]  P. Y. Coulon,et al.  Use of a TV Camera System in Closed-Loop Position Control of Mechanisms , 1983 .

[16]  Clifford C. Geschke.  A System for Programming and Controlling Sensor-Based Robot Manipulators , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Robert C. Bolles,et al.  Machine intelligence research applied to industrial automation , 1983 .

[18]  Ray A. Jarvis,et al.  A Perspective on Range Finding Techniques for Computer Vision , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  P. Kalata,et al.  The tracking index: A generalized parameter for α-β and α-β-γ target trackers , 1983, The 22nd IEEE Conference on Decision and Control.

[20]  Sundaram Ganapathy,et al.  Decomposition of transformation matrices for robot vision , 1984, Pattern Recognit. Lett..

[21]  Junichi Ikeda,et al.  A sealing robot system with visual seam tracking , 1984, Robotica.

[22]  Harry G. McCain,et al.  A hierarchically controlled, sensory interactive robot in the automated manufacturing research facility , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[23]  Gerald J. Agin.  Calibration and use of a light stripe range sensor mounted on the hand of a robot , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[24]  S. Arimoto,et al.  Sensory feedback for robot manipulators , 1985 .

[25]  Ronald Lumia,et al.  PIPE (Pipelined Image-Processing Engine) , 1985, J. Parallel Distributed Comput..

[26]  David Harwood,et al.  Passive ranging to known planar point sets , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[27]  P. J. Burt,et al.  Change Detection and Tracking Using Pyramid Transform Techniques , 1985, Other Conferences.

[28]  Lee E. Weiss,et al.  Dynamic visual servo control of robots: An adaptive image-based approach , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[29]  William F. Clocksin,et al.  An Implementation of Model-Based Visual Feedback for Robot Arc Welding of Thin Sheet Steel , 1985 .

[30]  Richard Kendall Miller,et al.  Machine Vision , 1986 .

[31]  Allan Robert Tate,et al.  Closed loop force control for a robotic grinding system , 1986 .

[32]  Robert J. Schalkoff,et al.  Control Implications in Tracking Moving Objects Using Time-Varying Perspective-Projective Imagery , 1986, IEEE Transactions on Industrial Electronics.

[33]  Vincent Hayward,et al.  Robot Manipulator Control under Unix RCCL: A Robot Control "C" Library , 1986 .

[34]  Rashpal S. Ahluwalia,et al.  A modular approach to visual servoing , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[35]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[36]  T. Strat.  Recovering the camera parameters from a transformation matrix , 1987 .

[37]  W. Eric L. Grimson,et al.  Handey: A robot system that recognizes, plans, and manipulates , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[38]  Michio Takahashi,et al.  Unpositioned Workpieces Handling Robot with Visual and Force Sensors , 1987, IEEE Transactions on Industrial Electronics.

[39]  W. Thomas Miller,et al.  Sensor-based control of robotic manipulators using a general learning algorithm , 1987, IEEE J. Robotics Autom..

[40]  Steven B. Skaar,et al.  Camera-Space Manipulation , 1987 .

[41]  R. L. Andersson.  Real time expert system to control a robot ping-pong player , 1987 .

[42]  Eugene S. McVey,et al.  An adaptive approach to video tracking , 1988, IEEE J. Robotics Autom..

[43]  Jake K. Aggarwal,et al.  On the computation of motion from sequences of images-A review , 1988, Proc. IEEE.

[44]  Mansur R. Kabuka,et al.  Robot vision tracking system , 1988 .

[45]  R. Bajcsy.  Active perception , 1988, Proc. IEEE.

[46]  Andrew K. Forrest,et al.  Visual detection of differential movement: applications to robotics , 1988, Robotica.

[47]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[48]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Michael Kuperstein,et al.  Generalized neural model for adaptive sensory-motor control of single postures , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[50]  John Todd Feddema,et al.  Real-time visual feedback control for hand-eye coordinated robotic systems , 1989 .

[51]  Rajnikant V. Patel,et al.  On-line robot trajectory planning for catching a moving object , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[52]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[53]  Gerd Hirzinger,et al.  On a Unified Concept for a New Generation of Light-Weight Robots , 1989, ISER.

[54]  Peter I. Corke,et al.  Video- Rate Visual Servoing for Robots , 1989, ISER.

[55]  Tomaso A. Poggio,et al.  Motion Field and Optical Flow: Qualitative Properties , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  Hideki Hashimoto,et al.  A control scheme of visual servo control of robotic manipulators using artificial neural network , 1989, Proceedings. ICCON IEEE International Conference on Control and Applications.

[57]  Phillip D. Adsit,et al.  Real-time intelligent control of a vision-servoed fruit-picking robot , 1989 .

[58]  Joseph S.-C. Yuan.  A general photogrammetric method for determining object position and orientation , 1989, IEEE Trans. Robotics Autom..

[59]  Ralph L. Hollis,et al.  A vision based correlator to actively damp vibrations of a coarse-fine manipulator , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[60]  Nasser Houshangi,et al.  Control of a robotic manipulator to grasp a moving target using vision , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[61]  R. L. Andersson.  A low-latency 60 Hz stereo vision system for real-time visual control , 1990, Proceedings. 5th IEEE International Symposium on Intelligent Control 1990.

[62]  Suresh Venkatesan,et al.  Realtime tracking in five degrees of freedom using two writs-mounted laser range finders , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[63]  Luc Van Gool,et al.  Stochastic predictive control of robot tracking systems with dynamic visual feedback , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[64]  David Vernon,et al.  Using camera motion to estimate range for robotic parts manipulation , 1990, IEEE Trans. Robotics Autom..

[65]  Bartlett W. Mel.  Connectionist Robot Motion Planning: A Neurally-Inspired Approach to Visually-Guided Reaching , 1990 .

[66]  Tsutomu Kimoto,et al.  Manipulator control with image-based visual servo , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[67]  Peter K. Allen,et al.  Real-time visual servoing , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[68]  Lawrence W. Stark,et al.  A supervisory telerobotic control system using model-based vision feedback , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[69]  C. S. George Lee,et al.  Weighted selection of image features for resolved rate visual feedback control , 1991, IEEE Trans. Robotics Autom..

[70]  Ole Ravn,et al.  Real-Time Vision Based Control of Servomechanical Systems , 1991, ISER.

[71]  P. K. Khosla,et al.  Adaptive Robotic Visual Tracking , 1991, 1991 American Control Conference.

[72]  Myung Jin Chung,et al.  Concepts of Augmented Image Space and Transformed Feature Space for Efficient Visual Servoing of an "Eye-in-Hand Robot" , 1991, Robotica.

[73]  G. Stange,et al.  Rangefinder based on intensity gradient measurement. , 1991, Applied optics.

[74]  Shahriar Negahdaripour,et al.  Undersea optical stationkeeping: Improved methods , 1991, J. Field Robotics.

[75]  William J. Wilson,et al.  Direct dynamic control of a robot using an end-point mounted camera and Kalman filter position estimation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[76]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[77]  G. Skofteland,et al.  Computing Position and Orientation of a Freeflying Polyhedron from 3D , 1991 .

[78]  Takeo Kanade,et al.  Vision and control techniques for robotic visual tracking , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[79]  C.M. Brown,et al.  Cooperative gaze holding in binocular vision , 1991, IEEE Control Systems.

[80]  Patrick Rives,et al.  Positioning of a robot with respect to an object, tracking it and estimating its velocity by visual servoing , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[81]  Z. Zenn Bien,et al.  Feature-based visual servoing of an eye-in-hand robot with improved tracking performance , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[82]  Daniel E. Koditschek,et al.  Preliminary Experiments in Spatial Robot Juggling , 1991, ISER.

[83]  Peter I. Corke,et al.  Dynamic effects in high-performance visual servoing , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[84]  Nikolaos Papanikolopoulos,et al.  Shared and traded telerobotic visual control , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[85]  Masayuki Inaba,et al.  Robot vision system with a correlation chip for real-time tracking, optical flow and depth map generation , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[86]  Jiang Wang,et al.  3D relative position and orientation estimation using Kalman filter for robot control , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.