Visual servoing with hand-eye manipulator-optimal control approach

This paper proposes a control theoretic formulation and a controller design method for the feature-based visual servoing with redundant features. The linear time-invariant (LTI) formulation copes with the redundant features and provides a simple framework for controller design. The proposed linear quadratic (LQ) method can deal with the redundant features, which is important because the previous LQ methods are not applicable to redundant systems. Moreover, this LQ method gives flexibility for performance improvement instead of the very limited design parameters provided by the generalized inverse and task function controllers. Validity of the LTI model and effectiveness and flexibility of the LQ optimal controller are evaluated by real-time experiments on a PUMA 560 manipulator.

[1]  Yoshiaki Shirai,et al.  Guiding a robot by visual feedback in assembling tasks , 1973, Pattern Recognit..

[2]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[3]  S. Arimoto,et al.  Sensory feedback for robot manipulators , 1985 .

[4]  Rashpal S. Ahluwalia,et al.  A modular approach to visual servoing , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[5]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[6]  Francis L. Merat,et al.  Introduction to robotics: Mechanics and control , 1987, IEEE J. Robotics Autom..

[7]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[8]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[10]  Mark W. Spong,et al.  Robot dynamics and control , 1989 .

[11]  Tsutomu Kimoto,et al.  Manipulator control with image-based visual servo , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[12]  C. S. George Lee,et al.  Weighted selection of image features for resolved rate visual feedback control , 1991, IEEE Trans. Robotics Autom..

[13]  Daniel E. Koditschek Some Applications of Natural Motion Control , 1991 .

[14]  Antti J. Koivo,et al.  Real-time vision feedback for servoing robotic manipulator with self-tuning controller , 1991, IEEE Trans. Syst. Man Cybern..

[15]  Yoshiki Uchikawa,et al.  Trajectory control of robotic manipulators using neural networks , 1991 .

[16]  Z. Zenn Bien,et al.  Feature-based visual servoing of an eye-in-hand robot with improved tracking performance , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[17]  Hideki Hashimoto,et al.  Visual control of robotic manipulator based on neural networks , 1992, IEEE Trans. Ind. Electron..

[18]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[19]  Patrick Rives,et al.  Singularities in the determination of the situation of a robot effector from the perspective view of 3 points , 1993 .

[20]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[21]  Peter K. Allen,et al.  Automated tracking and grasping of a moving object with a robotic hand-eye system , 1993, IEEE Trans. Robotics Autom..

[22]  Nikolaos Papanikolopoulos,et al.  Adaptive robotic visual tracking: theory and experiments , 1993, IEEE Trans. Autom. Control..

[23]  W. J. Wilson,et al.  Visual Servo Control of Robots Using Kalman Filter Estimates of Relative Pose , 1993 .

[24]  Hidenori Kimura,et al.  Dynamic Visual Servoing with Nonlinear Model-Based Control , 1993 .

[25]  Robert H. Cannon,et al.  Experiments in nonlinear adaptive control of multi-manipulator free-flying robots , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[26]  Oscar Nasisi,et al.  Adaptive robot control with visual feedback , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[27]  Bradley Eugene Bishop,et al.  Real-Time Visual Servo with Application to the Acrobot , 1994 .

[28]  Mark W. Spong,et al.  Fixed-camera visual servo control for planar robots , 1996, Proceedings of IEEE International Conference on Robotics and Automation.