Adaptive visual tracking for robotic systems without image-space velocity measurement

In this paper, we investigate the visual tracking problem for robotic systems without image-space velocity measurement, simultaneously taking into account the uncertainties of the camera model and the manipulator kinematics and dynamics. We propose a new image-space observer that exploits the image-space velocity information contained in the unknown kinematics, upon which, we design an adaptive controller without using the image-space velocity signal where the adaptations of the depth-rate-independent kinematic parameter and depth parameter are driven by both the image-space tracking errors and observation errors. The major superiority of the proposed observer-based adaptive controller lies in its simplicity and the separation of the handling of multiple uncertainties in visually servoed robotic systems, thus avoiding the overparametrization problem of the existing work. Using Lyapunov analysis, we demonstrate that the image-space tracking errors converge to zero asymptotically. The performance of the proposed adaptive control scheme is illustrated by a numerical simulation.

[1]  Weiping Li,et al.  Composite adaptive control of robot manipulators , 1989, Autom..

[2]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[3]  J. Slotine,et al.  On the Adaptive Control of Robot Manipulators , 1987 .

[4]  Chien Chern Cheah,et al.  Adaptive Tracking Control for Robots with Unknown Kinematic and Dynamic Properties , 2006, Int. J. Robotics Res..

[5]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[6]  Lakmal Seneviratne,et al.  Adaptive Control Of Robot Manipulators , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Liu Hsu,et al.  Adaptive 3D Visual Servoing without Image Velocity Measurement for Uncertain Manipulators , 2011 .

[8]  V. Jayaraman,et al.  Teach by zooming: A unified approach to visual servo control☆ , 2012 .

[9]  Yunhui Liu,et al.  Uncalibrated Visual Tracking Control Without Visual Velocity , 2010, IEEE Transactions on Control Systems Technology.

[10]  Yunhui Liu,et al.  Uncalibrated visual servoing of robots using a depth-independent interaction matrix , 2006, IEEE Transactions on Robotics.

[11]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[12]  Rafael Kelly,et al.  Stable visual servoing of camera-in-hand robotic systems , 2000 .

[13]  Chien Chern Cheah,et al.  Adaptive Vision based Tracking Control of Robots with Uncertainty in Depth Information , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[14]  Liu Hsu,et al.  Adaptive visual servoing scheme free of image velocity measurement for uncertain robot manipulators , 2013, Autom..

[15]  Petros A. Ioannou,et al.  Robust Adaptive Control , 2012 .

[16]  S. Shankar Sastry,et al.  Adaptive Control of Mechanical Manipulators , 1987 .

[17]  François Chaumette,et al.  Theoretical improvements in the stability analysis of a new class of model-free visual servoing methods , 2002, IEEE Trans. Robotics Autom..

[18]  Alessandro Astolfi,et al.  Two solutions to the adaptive visual servoing problem , 2001, IEEE Trans. Robotics Autom..

[19]  Warren E. Dixon,et al.  Tracking Control for Robot Manipulators with Kinematic and Dynamic Uncertainty , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[20]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .

[21]  Carl D. Meyer,et al.  Matrix Analysis and Applied Linear Algebra , 2000 .

[22]  B. Brogliato,et al.  Dissipative Systems Analysis and Control , 2000 .

[23]  Yunhui Liu,et al.  Uncalibrated visual tracking control without visual velocity , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[24]  Chien Chern Cheah,et al.  Adaptive Jacobian vision based control for robots with uncertain depth information , 2010, Autom..

[25]  Yunhui Liu,et al.  Dynamic Visual Tracking for Manipulators Using an Uncalibrated Fixed Camera , 2007, IEEE Transactions on Robotics.

[26]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[27]  Chien Chern Cheah,et al.  Adaptive Jacobian tracking control of robots with uncertainties in kinematic, dynamic and actuator models , 2006, IEEE Transactions on Automatic Control.

[28]  Chien Chern Cheah,et al.  Adaptive regional feedback control of robotic manipulator with uncertain kinematics and depth information , 2012, 2012 American Control Conference (ACC).

[29]  Romeo Ortega,et al.  Adaptive motion control of rigid robots: a tutorial , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[30]  Guoqiang Hu,et al.  Homography-Based Visual Servo Control With Imperfect Camera Calibration , 2009, IEEE Transactions on Automatic Control.

[31]  Warren E. Dixon,et al.  Quaternion‐based visual servo control in the presence of camera calibration error , 2010 .

[32]  Joe Brewer,et al.  Kronecker products and matrix calculus in system theory , 1978 .

[33]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[34]  Bernhard Maschke,et al.  Dissipative Systems Analysis and Control , 2000 .

[35]  Patrick Rives,et al.  Singularities in the determination of the situation of a robot effector from the perspective view of 3 points , 1993 .

[36]  Chien Chern Cheah,et al.  Adaptive Jacobian tracking control of rigid-link electrically driven robots based on visual task-space information , 2006, Autom..

[37]  Hidenori Kimura,et al.  Visual servoing with hand-eye manipulator-optimal control approach , 1996, IEEE Trans. Robotics Autom..

[38]  W.E. Dixon Adaptive regulation of amplitude limited robot manipulators with uncertain kinematics and dynamics , 2004, Proceedings of the 2004 American Control Conference.

[39]  Hanlei Wang Cascaded Framework for Adaptive Tracking of Robotic Systems with Uncertain Kinematics and Dynamics , 2012 .

[40]  Xinwu Liang,et al.  Uncalibrated Image‐Based Visual Servoing of Rigid‐Link Electrically Driven Robotic Manipulators , 2014 .