Visual control through the trifocal tensor for nonholonomic robots

We present a new vision-based control approach which drives autonomously a nonholonomic vehicle to a target location. The vision system is a camera fixed on the vehicle and the target location is defined by an image taken previously in that location. The control scheme is based on the trifocal tensor model, which is computed from feature correspondences in calibrated retina across three views: initial, current and target images. The contribution is a trifocal-based control law defined by an exact input-output linearization of the trifocal tensor model. The desired evolution of the system towards the target is directly defined in terms of the trifocal tensor elements by means of sinusoidal functions without needing metric or additional information from the environment. The trifocal tensor presents important advantages for visual control purposes, because it is more robust than two-view geometry as it includes the information of a third view and, contrary to the epipolar geometry, short baseline is not a problem. Simulations show the performance of the approach, which has been tested with image noise and calibration errors.

[1]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[2]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[3]  Kin Hong Wong,et al.  Recursive Camera-Motion Estimation With the Trifocal Tensor , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  S. Sastry,et al.  Nonholonomic motion planning: steering using sinusoids , 1993, IEEE Trans. Autom. Control..

[5]  Giuseppe Oriolo,et al.  Epipole-based visual servoing for nonholonomic mobile robots , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[6]  Nicholas R. Gans,et al.  A Stable Vision-Based Control Scheme for Nonholonomic Vehicles to Keep a Landmark in the Field of View , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[7]  Michael Werman,et al.  Trilinearity of three perspective views and its associated tensor , 1995, Proceedings of IEEE International Conference on Computer Vision.

[8]  Francois Chaumette,et al.  Potential problems of unstability and divergence in image-based and position-based visual servoing , 1999, 1999 European Control Conference (ECC).

[9]  Danica Kragic,et al.  Nonholonomic epipolar visual servoing , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[10]  Patrick Rives,et al.  Vision-based Control for Car Platooning using Homography Decomposition , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[12]  René Vidal,et al.  The multibody trifocal tensor: motion segmentation from 3 perspective views , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[13]  Ezio Malis.  Visual servoing invariant to changes in camera-intrinsic parameters , 2004, IEEE Trans. Robotics Autom..

[14]  Josechu J. Guerrero,et al.  Visual correction for mobile robot homing , 2005, Robotics Auton. Syst..

[15]  Patrick Rives,et al.  Visual servoing based on epipolar geometry , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[16]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[17]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[18]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[19]  Kin Hong Wong,et al.  Robust 3-D Motion Tracking From Stereo Images: A Model-Less Method , 2008, IEEE Transactions on Instrumentation and Measurement.

[20]  Éric Marchand,et al.  Feature tracking for visual servoing purposes , 2005, Robotics Auton. Syst..

[21]  Luc Van Gool,et al.  From omnidirectional images to hierarchical localization , 2007, Robotics Auton. Syst..

[22]  Ehud Rivlin,et al.  Visual homing: Surfing on the epipoles , 1997, Block Island Workshop on Vision and Control.

[23]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[24]  Carlos Sagüés,et al.  A novel 1D trifocal tensor-based control for differential-drive robots , 2009, 2009 IEEE International Conference on Robotics and Automation.

[25]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[26]  Long Quan,et al.  Structure from motion from three affine views , 2002, Object recognition supported by user interaction for service robots.

[27]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[28]  Warren E. Dixon,et al.  Homography-based visual servo regulation of mobile robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Josechu J. Guerrero,et al.  Homography-Based Visual Control of Nonholonomic Vehicles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[30]  A. Isidori.  Nonlinear Control Systems , 1985 .

[31]  Andrew Zisserman,et al.  Robust Parameterization and Computation of the Trifocal Tensor , 1996, BMVC.

[32]  Manolis I. A. Lourakis,et al.  Fast trifocal tensor estimation using virtual parallax , 2005, IEEE International Conference on Image Processing 2005.

[33]  Frank Dellaert,et al.  Linear 2D localization and mapping for single and multiple robot scenarios , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[34]  François Chaumette,et al.  2 1/2 D Visual Servoing with Respect to Unknown Objects Through a New Estimation Scheme of Camera Displacement , 2000, International Journal of Computer Vision.

[35]  Selim Benhimane,et al.  A unified approach to visual tracking and servoing , 2005, Robotics Auton. Syst..

[36]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .

[37]  Magnus Oskarsson,et al.  Solutions and Ambiguities of the Structure and Motion Problem for 1D Retinal Vision , 2000, Journal of Mathematical Imaging and Vision.

[38]  Warren E. Dixon,et al.  Homography-based visual servo tracking control of a wheeled mobile robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).