Dynamic Visual Tracking with Eye-in-hand Camera

This paper presents a new controller for locking a moving object in 3-D space at a particular position (for example the center) on the image plane of a camera mounted on a robot by actively moving the camera. The controller is designed to cope with both the highly nonlinear robot dynamics and unknown motion of the object. Based on the fact that the unknown position of the moving object appears linearly in the closed-loop dynamics of the system if the depth-independent image Jacobian is used, we developed a nonlinear observer to estimate the 3-D motion of the object on-line. With a full consideration of dynamic responses of the robot manipulator, we employed the Lyapunov method to prove asymptotic convergence of the image errors. Both simulation and experimental results are presented to support the approach in this paper.

[1]  P. K. Khosla,et al.  Adaptive Robotic Visual Tracking , 1991, 1991 American Control Conference.

[2]  Hidenori Kimura,et al.  Dynamic Visual Feedback Control For A Hand-eye Manipulator , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[4]  Nikolaos Papanikolopoulos,et al.  Adaptive robotic visual tracking: theory and experiments , 1993, IEEE Trans. Autom. Control..

[5]  Minoru Asada,et al.  Versatile visual servoing without knowledge of true Jacobian , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[6]  Peter K. Allen,et al.  Active, uncalibrated visual servoing , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[7]  Hidenori Kimura,et al.  Visual servoing with nonlinear observer , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[8]  Roberto Cipolla,et al.  Uncalibrated Visual Servoing , 1996, BMVC.

[9]  Rafael Kelly,et al.  Robust asymptotically stable visual servoing of planar robots , 1996, IEEE Trans. Robotics Autom..

[10]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[11]  Mark W. Spong,et al.  Camera modelling for visual servo control applications , 1996 .

[12]  Minoru Asada,et al.  Visual tracking of unknown moving object by adaptive binocular visual servoing , 1999, Proceedings. 1999 IEEE/SICE/RSJ. International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI'99 (Cat. No.99TH8480).

[13]  M.S. de Queiroz,et al.  Robust visual-servo control of robot manipulators in the presence of uncertainty , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[14]  Toshiro Noritsugu,et al.  Visual servoing based on object motion estimation , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[15]  Alessandro Astolfi,et al.  Two solutions to the adaptive visual servoing problem , 2001, IEEE Trans. Robotics Autom..

[16]  Warren E. Dixon,et al.  Object tracking by a robot manipulator: a robust cooperative visual servoing approach , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[17]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[18]  Toshiro Noritsugu,et al.  A mode switching estimator for visual servoing , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[19]  Ezio Malis.  Visual servoing invariant to changes in camera-intrinsic parameters , 2004, IEEE Trans. Robotics Autom..

[20]  Yunhui Liu,et al.  Dynamic Visual Servoing of Robots in Uncalibrated Environments , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[21]  Yunhui Liu,et al.  Uncalibrated visual servoing of robots using a depth-independent interaction matrix , 2006, IEEE Transactions on Robotics.

[22]  Yunhui Liu,et al.  Uncalibrated visual tracking control without visual velocity , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[23]  Yunhui Liu,et al.  Dynamic tracking of manipulators using visual feedback from an uncalibrated fixed camera , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..