Strategies for Increasing the Tracking Region of an Eye-in-Hand System by Singularity and Joint Limit Avoidance

An eye-in-hand system visually tracking objects can fail when the manipulator encounters a kinematic singularity or a joint limit. A solution to this problem is presented in which objects are visually tracked while the manipulator simultaneously avoids kinematic singularities and manipulator joint limits by moving in directions along which the tracking task space is unconstrained or redundant. A manipulability measure is introduced into the visual tracking objective function, providing an elegant and robust technique for deriving a control law that visually tracks objects while accounting for the configuration of the manipulator. Two different tracking strategies, one using a standard visual tracking strategy and the other using the newly proposed strategy, are experimentally compared on an actual hand/eye system. The experimental results demonstrate the effectiveness of the new method by showing that the tracking region of a manipulator tracking objects with planar motion can be greatly increased.

[1]  Charles W. Wampler,et al.  Manipulator Inverse Kinematic Solutions Based on Vector Formulations and Damped Least-Squares Methods , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  Pradeep K. Khosla,et al.  The resolvability ellipsoid for visual servoing , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  William L. Wilson,et al.  VISUAL SERVO CONTROL OF ROBOTS USING KALMAN FILTER ESTIMATES OF ROBOT POSE RELATIVE TO WORK-PIECES , 1993 .

[4]  Hidenori Kimura,et al.  LQ OPTIMAL AND NONLINEAR APPROACHES TO VISUAL SERVOING , 1993 .

[5]  Antti J. Koivo,et al.  Real-time vision feedback for servoing robotic manipulator with self-tuning controller , 1991, IEEE Trans. Syst. Man Cybern..

[6]  Tsuneo Yoshikawa,et al.  Manipulability of Robotic Mechanisms , 1985 .

[7]  Hidenori Kimura,et al.  Dynamic Visual Feedback Control For A Hand-eye Manipulator , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Nikolaos Papanikolopoulos,et al.  Selection of features and evaluation of visual measurements for 3-D robotic visual tracking , 1993, Proceedings of 8th IEEE International Symposium on Intelligent Control.

[9]  Peter I. Corke,et al.  Video- Rate Visual Servoing for Robots , 1989, ISER.

[10]  Peter K. Allen,et al.  Real-time motion tracking using spatio-temporal filters , 1989 .

[11]  P. Anandan.  Measuring Visual Motion From Image Sequences , 1987 .

[12]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[13]  J. T. Feddema,et al.  Adaptive image feature prediction and control for visual tracking with a moving camera , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[14]  P. K. Khosla,et al.  Adaptive Robotic Visual Tracking , 1991, 1991 American Control Conference.

[15]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[16]  Pradeep K. Khosla,et al.  The Chimera II real-time operating system for advanced sensor-based control applications , 1992, IEEE Trans. Syst. Man Cybern..

[17]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[18]  Larry Leifer,et al.  Applications of Damped Least-Squares Methods to Resolved-Rate and Resolved-Acceleration Control of Manipulators , 1988 .

[19]  C. S. George Lee,et al.  Adaptive image feature prediction and control for visual tracking with a hand-eye coordinated camera , 1990, IEEE Trans. Syst. Man Cybern..

[20]  Pradeep K. Khosla,et al.  Increasing the tracking region of an eye-in-hand system using controlled active vision , 1992, [Proceedings 1992] The First IEEE Conference on Control Applications.

[21]  Koichi Hashimoto,et al.  Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback , 1993 .

[22]  O. Egeland,et al.  Sensory Control in Singular Configurations Application to Visual Servoing , 1990, Proceedings of the IEEE International Workshop on Intelligent Motion Control.

[23]  Ashitava Ghosal,et al.  A New Approach for Kinematic Resolution of Redundancy , 1988, Int. J. Robotics Res..

[24]  Richard P. Paul,et al.  Kinematics of Robot Wrists , 1983 .

[25]  Barbara Hayes-Roth,et al.  Intelligent Control , 1994, Artif. Intell..

[26]  Nikolaos Papanikolopoulos,et al.  Full 3-D tracking using the controlled active vision paradigm , 1992, Proceedings of the 1992 IEEE International Symposium on Intelligent Control.

[27]  Kazuhiro Kosuge,et al.  Intelligent control of assembling robot using vision sensor , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[28]  Pradeep K. Khosla,et al.  Dexterity measures for design and control of manipulators , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[29]  Takeo Kanade,et al.  Geometric camera calibration using systems of linear equations , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[30]  Yoshihiko Nakamura,et al.  Inverse kinematic solutions with singularity robustness for robot manipulator control , 1986 .

[31]  Patrick Rives,et al.  Positioning of a robot with respect to an object, tracking it and estimating its velocity by visual servoing , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.