Unicycle-like Robots with Eye-in-Hand Monocular Cameras: From PBVS towards IBVS

This chapter presents an introduction to current research devoted to the visual servoing problem of guiding differentially driven robots, more specifically, unicycle-like vehicles, taking into consideration limited field of view (FOV) constraints. The goal is to carry out accurate servoing of the vehicle to a desired posture using only feedback from an on-board camera. First, a position based scheme is proposed, adopting a hybrid control law to cope with limited camera aperture. This scheme relies on a localization method based on extended Kalman filter (EKF) technique that takes into account the robot motion model and odometric data. To increase the potentiality of the visual servoing scheme with respect to existing solutions, which achieve similar goals locally (i.e., when the desired and actual camera views are sufficiently similar), the proposed method visually navigate the robot through an extended visual map before eventually reaching the desired goal. The map construction is part of the approach proposed here, which is then called visual simultaneous localization and mapping (VSLAM) for servoing. Position based scheme accuracy are intrinsically related to the effectiveness of the localization process, which is related to the estimation of 3D information on both the robot and the environment. A shortcut overcoming the estimation process uses visual information directly in the image domain. In this spirit, an image based scheme is presented. The controller is devoted to constantly track desired image feature trajectories. Such trajectories represent optimal (shortest) paths for the vehicle from the 3D initial position towards the desired one. Optimal trajectories satisfies the additional constraint of keeping a feature in sight of the camera and induces a taxonomy of the robot plane of motion into regions. It follows that the robot uses only visual data to determine the region to which it belongs and, hence, the associated optimal path. Similarly to the previous case, the visual scheme effectiveness is improved adopting appearance based image maps.

[1]  Gregory D. Hager,et al.  Efficient particle filtering using RANSAC with application to 3D face tracking , 2006, Image and Vision Computing.

[2]  Oussama Khatib,et al.  Experimental Robotics IV, The 4th International Symposium, Stanford, California, USA, June 30 - July 2, 1995 , 1997, ISER.

[3]  Antonio Bicchi,et al.  Optimal paths in a constrained image plane for purely image-based parking , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Patrick Gros,et al.  Robot motion control from a visual memory , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[5]  R. W. Brockett,et al.  Asymptotic stability and feedback stabilization , 1982 .

[6]  Antonio Bicchi,et al.  Visual Appearance Mapping for Optimal Vision Based Servoing , 2008, ISER.

[7]  Selim Benhimane,et al.  A new approach to vision-based robot control with omni-directional cameras , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[8]  Gregory Dudek,et al.  Collaborative exploration for the construction of visual maps , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[9]  Yeung Sam Hung,et al.  Visual servoing: a global path-planning approach , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[10]  François Chaumette,et al.  Path planning for robust image-based control , 2002, IEEE Trans. Robotics Autom..

[11]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[12]  Koichiro Deguchi,et al.  Optimal Motion Control for Image-Based Visual Servoing by Decoupling Translation and Rotation , 1999 .

[13]  Antonio Bicchi,et al.  Visual Servoing in the Large , 2009, Int. J. Robotics Res..

[14]  Josechu J. Guerrero,et al.  Switched Homography-Based Visual Control of Differential Drive Vehicles with Field-of-View Constraints , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[15]  Antonio Bicchi,et al.  A Hybrid-Control Approach to the Parking Problem of a Wheeled Vehicle Using Limited View-Angle Visual Feedback , 2004, Int. J. Robotics Res..

[16]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .

[17]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[18]  Giuseppe Oriolo,et al.  Image-Based Visual Servoing for Nonholonomic Mobile Robots Using Epipolar Geometry , 2007, IEEE Transactions on Robotics.

[19]  Stefano Soatto,et al.  Structure from Motion Causally Integrated Over Time , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Stefano Soatto,et al.  KALMANSAC: robust filtering by consensus , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[21]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[22]  Patrick Gros,et al.  Images interpolation for image-based control under large displacement , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[23]  Yeung Sam Hung,et al.  Global Path-Planning for Constrained and Optimal Visual Servoing , 2007, IEEE Transactions on Robotics.

[24]  Warren E. Dixon,et al.  Navigation function based visual servo control , 2005 .

[25]  Christophe Collewet,et al.  Positioning a camera with respect to planar objects of unknown shape by coupling 2-D visual servoing and 3-D estimations , 2002, IEEE Trans. Robotics Autom..

[26]  Paolo Pirjanian,et al.  The vSLAM Algorithm for Robust Localization and Mapping , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[27]  Rafael Murrieta-Cid,et al.  Optimal Paths for Landmark-Based Navigation by Differential-Drive Vehicles With Field-of-View Constraints , 2007, IEEE Transactions on Robotics.

[28]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[29]  Nicholas R. Gans,et al.  Stable Visual Servoing Through Hybrid Switched-System Control , 2007, IEEE Transactions on Robotics.

[30]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[31]  Paolo Pirjanian,et al.  A Visual Front-end for Simultaneous Localization and Mapping , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[32]  Michel Dhome,et al.  Outdoor autonomous navigation using monocular vision , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Domenico Prattichizzo,et al.  A switching control law for keeping features in the field of view in eye-in-hand visual servoing , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[34]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .