Design of Stable Visual Servoing Under Sensor and Actuator Constraints via a Lyapunov-Based Approach

In this brief, Lyapunov-based design techniques are utilized to propose a 2.5D visual servoing controller which stabilizes the robot end-effector pose while satisfying practical constraints on the sensing and the actuation. First, a nominal feedback controller is introduced which is then modified through an optimization-based approach in order to satisfy the constraints related to limited camera field-of-view and size of actuation. In the absence of actuator constraints, the proposed control law yields semi-global asymptotic (exponential) stability. When actuator constraints are introduced, the result is local asymptotic stability with known bounds on the region of attraction. Simulation and experimental results demonstrate the effectiveness of the proposed control methodology.

[1]  R. A. Spurrier.  Comment on " Singularity-Free Extraction of a Quaternion from a Direction-Cosine Matrix" , 1978 .

[2]  François Chaumette,et al.  2 1/2 D Visual Servoing with Respect to Unknown Objects Through a New Estimation Scheme of Camera Displacement , 2000, International Journal of Computer Vision.

[3]  Guoqiang Hu,et al.  Homography-Based Visual Servo Control With Imperfect Camera Calibration , 2009, IEEE Transactions on Automatic Control.

[4]  Josechu J. Guerrero,et al.  Switched Homography-Based Visual Control of Differential Drive Vehicles with Field-of-View Constraints , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[5]  Nicholas R. Gans,et al.  Stable Visual Servoing Through Hybrid Switched-System Control , 2007, IEEE Transactions on Robotics.

[6]  Patrick Rives,et al.  Robustness of image-based visual servoing with respect to depth distribution errors , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[7]  Warren E. Dixon,et al.  Adaptive 2.5D visual servoing of kinematically redundant robot manipulators , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[8]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[9]  Nicolás García Aracil,et al.  Continuous visual servoing despite the changes of visibility in image features , 2005, IEEE Transactions on Robotics.

[10]  François Chaumette,et al.  Path planning for robust image-based control , 2002, IEEE Trans. Robotics Autom..

[11]  Dae-Jin Kim,et al.  Eye-in-hand stereo visual servoing of an assistive robot arm in unstructured environments , 2009, 2009 IEEE International Conference on Robotics and Automation.

[12]  Zhao Wang,et al.  An optimization-based approach for design and analysis of stable 2.5D visual servoing under sensor and actuator constraints , 2010, 49th IEEE Conference on Decision and Control (CDC).

[13]  Daniel E. Koditschek,et al.  Visual servoing via navigation functions , 2002, IEEE Trans. Robotics Autom..

[14]  Philippe Martinet,et al.  Position based visual servoing: keeping the object in the field of vision , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[15]  François Chaumette,et al.  2½D visual servoing , 1999, IEEE Trans. Robotics Autom..

[16]  Warren E. Dixon,et al.  Adaptive homography-based visual servo tracking for a fixed camera configuration with a camera-in-hand extension , 2005, IEEE Transactions on Control Systems Technology.

[17]  Domenico Prattichizzo,et al.  Keeping features in the field of view in eye-in-hand visual servoing: a switching approach , 2004, IEEE Transactions on Robotics.

[18]  François Chaumette,et al.  Path planning in image space for robust visual servoing , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[19]  Peter I. Corke,et al.  A new partitioned approach to image-based visual servo control , 2001, IEEE Trans. Robotics Autom..

[20]  O. I. Kostyukova,et al.  An algorithm for solving quadratic programming problems with linear equality and inequality constraints , 2001 .

[21]  William J. Wilson,et al.  Hybrid motion control and planning strategies for visual servoing , 2005, IEEE Transactions on Industrial Electronics.

[22]  Warren E. Dixon,et al.  Navigation function based visual servo control , 2005 .

[23]  Graziano Chesi,et al.  Visual Servoing Path Planning via Homogeneous Forms and LMI Optimizations , 2009, IEEE Transactions on Robotics.

[24]  Ezio Malis.  Contributions a la modelisation et a la commande en asservissement visuel , 1998 .

[25]  C. V. Jawahar,et al.  Path planning approach to visual servoing with feature visibility constraints: A convex optimization based solution , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Nicholas R. Gans,et al.  Homography-Based Control Scheme for Mobile Robots With Nonholonomic and Field-of-View Constraints , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  Nicolas Mansard,et al.  A Qualitative Visual Servoing to ensure the Visibility Constraint , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Graziano Chesi,et al.  Visual servoing for large camera displacements , 2004, IEEE Transactions on Robotics.

[29]  A.H.A. Hafez,et al.  Hybrid Visual Servoing by Boosting IBVS and PBVS , 2008, 2008 3rd International Conference on Information and Communication Technologies: From Theory to Applications.

[30]  Warren E. Dixon,et al.  Adaptive homography-based visual servo tracking , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).