Continuous visual servoing despite the changes of visibility in image features

In the recent past, the visibility problem in vision-based control has been widely investigated. The proposed solutions generally have a common goal: to always keep the object in the camera's field of view during the visual servoing. Contrary to this solution, we propose a new approach based on the concept of allowing the changes of visibility in image features during the control task. To this aim, the camera invariant visual-servoing approach has been redefined in order to take into account the changes of visibility in image features. A new smooth task function using weighted features is presented, and a continuous control law is obtained starting from it by imposing its exponential decrease to zero. Furthermore, the local stability analysis of the invariant visual-servoing approach with weighted features is presented. Finally, this promising way of dealing with the visibility issue has been successfully tested with an eye-in-hand robotic system.

[1]  R. Decarlo,et al.  Variable structure control of nonlinear multivariable systems: a tutorial , 1988, Proc. IEEE.

[2]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.

[3]  Vadim I. Utkin,et al.  Robot path obstacle avoidance control via sliding mode approach , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[4]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[5]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[6]  Daniel E. Koditschek,et al.  Exact robot navigation using artificial potential functions , 1992, IEEE Trans. Robotics Autom..

[7]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[8]  Koichi Hashimoto,et al.  Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback , 1993 .

[9]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[10]  Hiroaki Yamaguchi,et al.  A Cooperative Hunting Behavior by Mobile-Robot Troops , 1999, Int. J. Robotics Res..

[11]  Naomi Ehrich Leonard,et al.  Virtual leaders, artificial potentials and coordinated control of groups , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[12]  Vijay Kumar,et al.  Modeling and control of formations of nonholonomic mobile robots , 2001, IEEE Trans. Robotics Autom..

[13]  Xiaoming Hu,et al.  Formation constrained multi-agent control , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[14]  Peter I. Corke,et al.  A new partitioned approach to image-based visual servo control , 2001, IEEE Trans. Robotics Autom..

[15]  Ezio Malis,et al.  Vision-based control invariant to camera intrinsic parameters: stability analysis and path tracking , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[16]  François Chaumette,et al.  Path planning for robust image-based control , 2002, IEEE Trans. Robotics Autom..

[17]  Richard M. Murray,et al.  DISTRIBUTED COOPERATIVE CONTROL OF MULTIPLE VEHICLE FORMATIONS USING STRUCTURAL POTENTIAL FUNCTIONS , 2002 .

[18]  A. Vicino,et al.  Keeping features in the camera ’ s field of view : a visual servoing strategy , 2002 .

[19]  Naomi Ehrich Leonard,et al.  Vehicle networks for gradient descent in a sampled environment , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[20]  Petter Ögren,et al.  Formations with a Mission: Stable Coordination of Vehicle Group Maneuvers , 2002 .

[21]  Yang Liu,et al.  Stability analysis of M-dimensional asynchronous swarms with a fixed communication topology , 2003, IEEE Trans. Autom. Control..

[22]  Selim Benhimane,et al.  Vision-based control with respect to planar and non-planar objects using a zooming camera , 2003 .

[23]  Kevin M. Passino,et al.  Stability analysis of swarms , 2003, IEEE Trans. Autom. Control..

[24]  Éric Marchand,et al.  A visual servoing control law that is robust to image outliers , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[25]  Veysel Gazi,et al.  Formation control of a multi-agent system using decentralized nonlinear servomechanism , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[26]  Ezio Malis,et al.  Stability Analysis of Invariant Visual Servoing and Robustness to Parametric Uncertainties , 2003, Control Problems in Robotics.

[27]  Veysel Gazi,et al.  Swarm aggregations using artificial potentials and sliding mode control , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[28]  François Chaumette,et al.  Optimal Camera Trajectory with Image-Based Control , 2003, Int. J. Robotics Res..

[29]  Ezio Malis,et al.  Preserving the continuity of visual servoing despite changing image features , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[30]  D. Grünbaum Schooling as a strategy for taxis in a noisy environment , 1998, Evolutionary Ecology.

[31]  Raúl Ordóñez,et al.  Target tracking using artificial potentials and sliding mode control , 2007, Proceedings of the 2004 American Control Conference.

[32]  Ezio Malis Visual servoing invariant to changes in camera-intrinsic parameters , 2004, IEEE Trans. Robotics Autom..

[33]  Larry S. Davis,et al.  Model-based object pose in 25 lines of code , 1992, International Journal of Computer Vision.

[34]  Kevin M. Passino,et al.  Stability of a one-dimensional discrete-time asynchronous swarm , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).