Uncalibrated visual servoing of mobile manipulators with an eye-to-hand camera

Most research on the visual servoing of mobile manipulators used the assumption that the depth information is already known. In this paper, a visual servoing scheme without the prior knowledge of depth is proposed to regulate a mobile manipulator to a desired pose at eye-to-hand setup. To deal with the nonholonomic constraint of wheeled mobile platform, the Jacobian matrix was combined with the depth-independent matrix to construct the image Jacobian. To avoid the sophisticated process of calibration, a parameter updating rule based on the depth independent matrix is developed to estimate the intrinsic and extrinsic parameters. Lyapunov theory is used to prove the asymptotic convergence of the image errors. Simulation have been implemented on a 6-DOF mobile manipulator. Simulation results show the effect of the algorithm.

[1]  François Chaumette,et al.  2½D visual servoing , 1999, IEEE Trans. Robotics Autom..

[2]  Peter K. Allen,et al.  Active, uncalibrated visual servoing , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[3]  Nikolaos Papanikolopoulos,et al.  Six degree-of-freedom hand/eye visual tracking with uncertain parameters , 1995, IEEE Trans. Robotics Autom..

[4]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[5]  W. J. Wilson,et al.  A modified resolved acceleration controller for position-based visual servoing , 1996 .

[6]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[7]  Giuseppe Oriolo,et al.  Image-based visual servoing schemes for nonholonomic mobile manipulators , 2007, Robotica.

[8]  Yunhui Liu,et al.  Adaptive Visual Servoing Using Point and Line Features With an Uncalibrated Eye-in-Hand Camera , 2008, IEEE Transactions on Robotics.

[9]  Harvey Lipkin,et al.  Uncalibrated dynamic visual servoing , 2004, IEEE Transactions on Robotics and Automation.

[10]  Olac Fuentes,et al.  Experimental evaluation of uncalibrated visual servoing for precision manipulation , 1997, Proceedings of International Conference on Robotics and Automation.

[11]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[12]  Peter K. Allen,et al.  Automated tracking and grasping of a moving object with a robotic hand-eye system , 1993, IEEE Trans. Robotics Autom..

[13]  Alessandro Astolfi,et al.  Two solutions to the adaptive visual servoing problem , 2001, IEEE Trans. Robotics Autom..

[14]  Ezio Malis.  Visual servoing invariant to changes in camera-intrinsic parameters , 2004, IEEE Trans. Robotics Autom..

[15]  Hesheng Wang,et al.  Visual servoing of robots with uncalibrated robot and camera parameters , 2012 .

[16]  Oussama Khatib,et al.  Mobile manipulation: The robotic assistant , 1999, Robotics Auton. Syst..

[17]  E. Mjolsness,et al.  Online computation of exterior orientation with application to hand-eye calibration , 1996 .

[18]  Radu Horaud,et al.  Visual tracking of an end-effector by adaptive kinematic prediction , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[19]  Yunhui Liu,et al.  Dynamic tracking of manipulators using visual feedback from an uncalibrated fixed camera , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[20]  Nikolaos Papanikolopoulos,et al.  Adaptive robotic visual tracking: theory and experiments , 1993, IEEE Trans. Autom. Control..

[21]  Mark W. Spong,et al.  Adaptive calibration and control of 2D monocular visual servo systems , 1997 .

[22]  Toshiyuki Murakami,et al.  A Control of Two Wheels Driven Redundant Mobile Manipulator Using A Monocular Camera System , 2008, 2008 15th International Conference on Mechatronics and Machine Vision in Practice.

[23]  M. Mehrandezh,et al.  Visual Servoing of a 5-DOF Mobile Manipulator Using a Panoramic Vision System , 2007, 2007 Canadian Conference on Electrical and Computer Engineering.

[24]  Ezio Malis.  Visual servoing invariant to changes in camera-intrinsic parameters , 2001, IEEE Transactions on Robotics and Automation.

[25]  Yunhui Liu,et al.  Uncalibrated visual tracking control without visual velocity , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[26]  Giuseppe Oriolo,et al.  On-Line Estimation of Feature Depth for Image-Based Visual Servoing Schemes , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[27]  Minoru Asada,et al.  Versatile visual servoing without knowledge of true Jacobian , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[28]  Francois Chaumette,et al.  Potential problems of unstability and divergence in image-based and position-based visual servoing , 1999, 1999 European Control Conference (ECC).

[29]  Andrew A. Goldenberg,et al.  Articulated robotic scanner for mine detection: a novel approach to vehicle-mounted systems , 1999, Defense, Security, and Sensing.

[30]  E. Malis,et al.  2D 1/2 Visual Servoing , 1998 .

[31]  Yunhui Liu,et al.  Uncalibrated visual servoing of robots using a depth-independent interaction matrix , 2006, IEEE Transactions on Robotics.

[32]  Minglu Zhang,et al.  Based on Kalman Filter the Mobile Manipulator Non-calibration Free Dynamic Target Tracking Technology Research , 2009, 2009 International Conference on Electronic Computer Technology.