Path-Planning for Visual Servoing: A Review and Issues

In this survey we provide a comprehensive technical review of existing major approaches to path-planning for visual servoing. Visual servoing has been introduced as a promising approach for sensor-based robotic tasks. The basic visual servoing task is to guide the motion of a robot with respect to a target object based on the feedback obtained through a vision system. Amalgamation of path-planning techniques with reactive visual servoing strategies can robustify existing image-based tracking systems in robotics applications where a high disparity between the initial and desired views of a target is inevitable (e.g., target interception, space docking, reaching and grasping, etc). The planning stage does so by accounting for critical constraints and uncertainties in the system resulting in a more robust visual servoing process. We discuss different planning approaches, explain the associated set of constraints and assumptions, and discuss the underlying pathplanning techniques along with the issues regarding their integration with reactive visual servo controllers.

[1]  Héctor H. González-Baños,et al.  Motion strategies for maintaining visibility of a moving target , 1997, Proceedings of International Conference on Robotics and Automation.

[2]  François Chaumette,et al.  2 1/2 D Visual Servoing with Respect to Unknown Objects Through a New Estimation Scheme of Camera Displacement , 2000, International Journal of Computer Vision.

[3]  Josechu J. Guerrero,et al.  Switched Homography-Based Visual Control of Differential Drive Vehicles with Field-of-View Constraints , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[4]  Guillaume Morel,et al.  Explicit Incorporation of 2D Constraints in Vision Based Control of Robot Manipulators , 1999, ISER.

[5]  Antonio Bicchi,et al.  Optimal paths in a constrained image plane for purely image-based parking , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Rajeev Sharma,et al.  Motion perceptibility and its application to active vision-based servo control , 1997, IEEE Trans. Robotics Autom..

[7]  Franck Plestan,et al.  Robust visual servoing: bounding the task function tracking errors , 2005, IEEE Transactions on Control Systems Technology.

[8]  James P. Ostrowski,et al.  Visual motion planning for mobile robots , 2002, IEEE Trans. Robotics Autom..

[9]  Danica Kragic,et al.  Measurement errors in visual servoing , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[10]  Kamal K. Gupta,et al.  Path planning with general end-effector constraints , 2007, Robotics Auton. Syst..

[11]  Reid G. Simmons,et al.  Particle RRT for Path Planning with Uncertainty , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[12]  Nicola J. Ferrier,et al.  Visual servoing: path interpolation by homography decomposition , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[13]  Ezio Malis.  Visual servoing invariant to changes in camera-intrinsic parameters , 2004, IEEE Trans. Robotics Autom..

[14]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[15]  Yeung Sam Hung,et al.  Global Path-Planning for Constrained and Optimal Visual Servoing , 2007, IEEE Transactions on Robotics.

[16]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[17]  Roberto Cipolla,et al.  Automatic segmentation and matching of planar contours for visual servoing , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[18]  Kamal K. Gupta,et al.  Global path planning for robust Visual Servoing in complex environments , 2009, 2009 IEEE International Conference on Robotics and Automation.

[19]  Peter I. Corke,et al.  A new partitioned approach to image-based visual servo control , 2001, IEEE Trans. Robotics Autom..

[20]  P. Poignet,et al.  Image Based Visual Servoing through Nonlinear Model Predictive Control , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[21]  Éric Marchand,et al.  Real-time markerless tracking for augmented reality: the virtual visual servoing framework , 2006, IEEE Transactions on Visualization and Computer Graphics.

[22]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[23]  Bernard Espiau,et al.  Effect of Camera Calibration Errors on Visual Servoing in Robotics , 1993, ISER.

[24]  Koichiro Deguchi,et al.  Optimal Motion Control for Image-Based Visual Servoing by Decoupling Translation and Rotation , 1999 .

[25]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .

[26]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[27]  William J. Wilson,et al.  Hybrid motion control and planning strategies for visual servoing , 2005, IEEE Transactions on Industrial Electronics.

[28]  Rafael Murrieta-Cid,et al.  A Motion Planner for Maintaining Landmark Visibility with a Differential Drive Robot , 2008, WAFR.

[29]  Danica Kragic,et al.  New shortest-path approaches to visual servoing , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[30]  Peter I. Corke,et al.  Performance Tests for Visual Servo Control Systems, with Application to Partitioned Approaches to Visual Servo Control , 2003, Int. J. Robotics Res..

[31]  Minoru Asada,et al.  Trajectory generation for obstacle avoidance of uncalibrated stereo visual servoing without 3D reconstruction , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[32]  François Chaumette,et al.  Path planning for robust image-based control , 2002, IEEE Trans. Robotics Autom..

[33]  Domenico Prattichizzo,et al.  Keeping features in the field of view in eye-in-hand visual servoing: a switching approach , 2004, IEEE Transactions on Robotics.

[34]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[35]  O. Lang,et al.  Visual control of 6 DOF robots with constant object size in the image by means of zoom camera , 1999, IECON'99. Conference Proceedings. 25th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.99CH37029).

[36]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[37]  Francois Chaumette,et al.  Potential problems of unstability and divergence in image-based and position-based visual servoing , 1999, 1999 European Control Conference (ECC).

[38]  Russell H. Taylor,et al.  Automatic Synthesis of Fine-Motion Strategies for Robots , 1984 .

[39]  Myung Jin Chung,et al.  Path planning with uncalibrated stereo rig for image-based visual servoing under large pose discrepancy , 2003, IEEE Trans. Robotics Autom..

[40]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[41]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[42]  Kamal K. Gupta,et al.  RRT-SLAM for motion planning with motion and map uncertainty for robot exploration , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  Konstantinos A. Tarabanis,et al.  Computing Occlusion-Free Viewpoints , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Rajeev Sharma,et al.  A framework for robot motion planning with sensor constraints , 1997, IEEE Trans. Robotics Autom..

[45]  Guillaume Morel,et al.  Ensuring visibility in calibration-free path planning for image-based visual servoing , 2006, IEEE Transactions on Robotics.

[46]  Graziano Chesi,et al.  Visual Servoing Path Planning via Homogeneous Forms and LMI Optimizations , 2009, IEEE Transactions on Robotics.

[47]  Rafael Murrieta-Cid,et al.  Optimal Paths for Landmark-Based Navigation by Differential-Drive Vehicles With Field-of-View Constraints , 2007, IEEE Transactions on Robotics.

[48]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[49]  François Chaumette,et al.  Optimal Camera Trajectory with Image-Based Control , 2003, Int. J. Robotics Res..

[50]  James J. Little,et al.  Occlusion-free path planning with a probabilistic roadmap , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[51]  Alain Lambert,et al.  Safe Path Planning in an Uncertain-Configuration Space using RRT , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[52]  Toshiro Noritsugu,et al.  Potential problems and switching control for visual servoing , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[53]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[54]  Nicholas R. Gans,et al.  Stable Visual Servoing Through Hybrid Switched-System Control , 2007, IEEE Transactions on Robotics.

[55]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[56]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[57]  Robert E. Mahony,et al.  A decoupled image space approach to visual servo control of a robotic manipulator , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[58]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[59]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[60]  Benedetto Allotta,et al.  3D Motion Planning for Image-Based Visual Servoing Tasks , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[61]  Graziano Chesi,et al.  Title Designing image trajectories in the presence of uncertain datafor robust visual servoing path-planning , 2009 .

[62]  Rüdiger Dillmann,et al.  Planning for robust execution of humanoid motions using future perceptive capability , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[63]  Daniel E. Koditschek,et al.  Visual servoing via navigation functions , 2002, IEEE Trans. Robotics Autom..

[64]  Domenico Prattichizzo,et al.  Straight line path-planning in visual servoing , 2007 .

[65]  Giuseppe Oriolo,et al.  A Bayesian framework for optimal motion planning with uncertainty , 2008, 2008 IEEE International Conference on Robotics and Automation.