Uncalibrated Eye-in-Hand Visual Servoing

In this paper we present new uncalibrated control schemes for vision-guided robotic tracking of a moving target using a moving camera. These control methods are applied to an uncalibrated robotic system with eye-in-hand visual feedback. Without a priori knowledge of the robot's kinematic model or camera calibration, the system is able to track a moving object through a variety of motions and maintain the object's image features in a desired position in the image plane. These control schemes estimate the system Jacobian as well as changes in target features due to target motion. Four novel strategies are simulated and a variety of parameters are investigated with respect to performance. Simulation results suggest that a Gauss-Newton method utilizing a partitioned Broyden's method for model estimation provides the best steady-state tracking behavior.

[1]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[2]  Minoru Asada,et al.  Adaptive hybrid control for visual and force servoing in an unknown environment , 1998, IEEE Robotics Autom. Mag..

[3]  François Chaumette,et al.  Theoretical improvements in the stability analysis of a new class of model-free visual servoing methods , 2002, IEEE Trans. Robotics Autom..

[4]  Patrick Bouthemy,et al.  Complex object tracking by visual servoing based on 2D image motion , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[5]  Harvey Lipkin,et al.  Experimental results using vision-based control for uncalibrated robotic systems , 1999, Optics East.

[6]  H. Lipkin,et al.  A dynamic quasi-newton method for model independent visual servoing , 1999 .

[7]  Gene F. Franklin,et al.  Digital control of dynamic systems , 1980 .

[8]  Peter I. Corke,et al.  A new partitioned approach to image-based visual servo control , 2001, IEEE Trans. Robotics Autom..

[9]  J. De Schutter,et al.  Improving force controlled planar contour following using online eye-in-hand vision based feedforward , 1999, 1999 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Cat. No.99TH8399).

[10]  Harvey Lipkin,et al.  A dynamic quasi-Newton method for uncalibrated visual servoing , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[11]  Benedetto Allotta,et al.  On the use of linear camera-object interaction models in visual servoing , 1999, IEEE Trans. Robotics Autom..

[12]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[13]  Peter I. Corke,et al.  A robotics toolbox for MATLAB , 1996, IEEE Robotics Autom. Mag..

[14]  Toshiro Noritsugu,et al.  Visual servoing with linearized observer , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[15]  Peter K. Allen,et al.  Visual servoing by partitioning degrees of freedom , 2001, IEEE Trans. Robotics Autom..

[16]  Minoru Asada,et al.  Versatile visual servoing without knowledge of true Jacobian , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[17]  Patrick Rives,et al.  Positioning of a robot with respect to an object, tracking it and estimating its velocity by visual servoing , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[18]  Éric Marchand,et al.  Eye-in-hand/eye-to-hand cooperation for visual servoing , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[19]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[20]  Olac Fuentes,et al.  Experimental evaluation of uncalibrated visual servoing for precision manipulation , 1997, Proceedings of International Conference on Robotics and Automation.

[21]  Ezio Malis,et al.  Vision-based control invariant to camera intrinsic parameters: stability analysis and path tracking , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[22]  Peter K. Allen,et al.  Active, uncalibrated visual servoing , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[23]  Z. Zenn Bien,et al.  Feature-based visual servoing of an eye-in-hand robot with improved tracking performance , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.