Dealing With Constraints in Sensor-Based Robot Control

A framework is presented in this paper for the control of a multisensor robot under several constraints. In this approach, the features coming from several sensors are treated as a single feature vector. The core of our approach is a weighting matrix that balances the contribution of each feature, allowing the taking of constraints into account. The constraints are considered as additional features that are smoothly injected in the control law. Multisensor modeling is introduced for the design of the control law, drawing similarities with linear quadratic control. The main properties are exposed and we propose several strategies to cope with the main drawbacks. The framework is validated in a complex experiment, illustrating various aspects of the approach. The goal is the positioning of a six-DOF robot arm with 3-D visual servoing. The considered constraints are both eye-in-hand and eye-to-hand visibility, together with joint limit avoidance. The system is thus highly overdetermined, yet the task can be performed while ensuring several combinations of constraints.

[1]  Rs Roel Pieters,et al.  Visual Servo Control , 2012 .

[2]  Chien Chern Cheah,et al.  Region-Reaching Control of Robots , 2007, IEEE Transactions on Robotics.

[3]  Éric Marchand,et al.  Statistically robust 2-D visual servoing , 2006, IEEE Transactions on Robotics.

[4]  Olivier Kermorgant,et al.  Avoiding joint limits with a low-level fusion scheme , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  William J. Wilson,et al.  Relative end-effector control using Cartesian position based visual servoing , 1996, IEEE Trans. Robotics Autom..

[6]  Olivier Kermorgant,et al.  Multi-sensor data fusion in sensor-based control: Application to multi-camera visual servoing , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Pierre-Brice Wieber,et al.  Kinematic Control of Redundant Manipulators: Generalizing the Task-Priority Framework to Inequality Task , 2011, IEEE Transactions on Robotics.

[8]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[9]  Nicolas Mansard,et al.  Continuity of Varying-Feature-Set Control Laws , 2009, IEEE Transactions on Automatic Control.

[10]  Victor M. Becerra,et al.  Optimal control , 2008, Scholarpedia.

[11]  Farbod Fahimi,et al.  Real-time obstacle avoidance for multiple mobile robots , 2009, Robotica.

[12]  Pierre-Brice Wieber,et al.  Analysis of the discontinuities in prioritized tasks-space control under discreet task scheduling operations , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Yeung Sam Hung,et al.  Global Path-Planning for Constrained and Optimal Visual Servoing , 2007, IEEE Transactions on Robotics.

[14]  François Chaumette,et al.  Design and tracking of desirable trajectories in the image space by integrating mechanical and visibility constraints , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[15]  S. Brooks,et al.  Optimization Using Simulated Annealing , 1995 .

[16]  William J. Wilson,et al.  Hybrid motion control and planning strategies for visual servoing , 2005, IEEE Transactions on Industrial Electronics.

[17]  Oussama Khatib,et al.  A Unified Approach to Integrate Unilateral Constraints in the Stack of Tasks , 2009, IEEE Transactions on Robotics.

[18]  Kamal K. Gupta,et al.  Kinodynamic planning for visual servoing , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[20]  Guillaume Morel,et al.  Robot Control Using Disparate Multiple Sensors , 2001, Int. J. Robotics Res..

[21]  Nahum Shimkin,et al.  Nonlinear Control Systems , 2008 .

[22]  Nicolás García Aracil,et al.  Continuous visual servoing despite the changes of visibility in image features , 2005, IEEE Transactions on Robotics.

[23]  Joris De Schutter,et al.  Extending iTaSC to support inequality constraints and non-instantaneous task specification , 2009, 2009 IEEE International Conference on Robotics and Automation.

[24]  François Chaumette,et al.  A new large projection operator for the redundancy framework , 2010, 2010 IEEE International Conference on Robotics and Automation.

[25]  Robin J. Evans,et al.  Constrained pole-placement using transformation and LQ-design , 1987, Autom..

[26]  Tao Li,et al.  Maintaining visibility constraints during tele-echography with ultrasound visual servoing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[27]  Guillaume Morel,et al.  Ensuring visibility in calibration-free path planning for image-based visual servoing , 2006, IEEE Transactions on Robotics.

[28]  Olivier Kermorgant,et al.  Combining IBVS and PBVS to ensure the visibility constraint , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Éric Marchand,et al.  Efficient model-based tracking for robot vision , 2005, Adv. Robotics.

[30]  Pradeep K. Khosla,et al.  Strategies for Increasing the Tracking Region of an Eye-in-Hand System by Singularity and Joint Limit Avoidance , 1995, Int. J. Robotics Res..

[31]  Tsuneo Yoshikawa.  Basic optimization methods of redundant manipulators , 1996 .

[32]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[33]  Nicholas R. Gans,et al.  Stable Visual Servoing Through Hybrid Switched-System Control , 2007, IEEE Transactions on Robotics.

[34]  Michel Perrier,et al.  Controlling an Uninstrumented Manipulator By Visual Servoing , 2002, Int. J. Robotics Res..

[35]  Jean-Claude Latombe,et al.  Robot Motion Planning: A Distributed Representation Approach , 1991, Int. J. Robotics Res..

[36]  C. V. Jawahar,et al.  Visual Servoing by Optimization of a 2D/3D Hybrid Objective Function , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[37]  Omar Tahri,et al.  Robotics and Autonomous Systems , 2006 .

[38]  Richard P. Paul,et al.  Robot manipulators : mathematics, programming, and control : the computer control of robot manipulators , 1981 .

[39]  C. Loan.  On the Method of Weighting for Equality Constrained Least Squares Problems , 1984 .

[40]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[41]  Éric Marchand,et al.  ViSP for visual servoing: a generic software platform with a wide class of robot control skills , 2005, IEEE Robotics & Automation Magazine.

[42]  Nicolas Mansard,et al.  Task Sequencing for High-Level Sensor-Based Control , 2007, IEEE Transactions on Robotics.

[43]  Minoru Asada,et al.  Adaptive hybrid control for visual and force servoing in an unknown environment , 1998, IEEE Robotics Autom. Mag..

[44]  François Chaumette,et al.  Predictive Control for Constrained Image-Based Visual Servoing , 2010, IEEE Transactions on Robotics.

[45]  Graziano Chesi,et al.  Visual Servoing Path Planning via Homogeneous Forms and LMI Optimizations , 2009, IEEE Transactions on Robotics.

[46]  Patrick Danès,et al.  Towards an LMI approach to multicriteria visual servoing , 2001, 2001 European Control Conference (ECC).

[47]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.