Monocular visual navigation of an autonomous vehicle in natural scene corridor-like environments

We present a monocular visual navigation methodology for autonomous orchard vehicles. Modern orchards are usually planted with straight and parallel tree rows that form a corridor-like environment. Our task consists of driving a vehicle autonomously along the tree rows. The original contributions of this paper are: 1) a method to recover vehicle rotation independently of translation by modeling the vehicle as a car-like robot driving on a 3D ground surface-the rotation is estimated from monocular images while the translation is measured by a wheel encoder; and 2) a method to fit the 3D points corresponding to the trees into straight lines via an optimization algorithm that minimizes the error variance on the robot lookahead point. Additionally, we use a simple vanishing point detection approach to find the ends of the tree rows. The vanishing point detection is integrated into the system via an extended Kalman filter. The methodology's robustness to environmental changes is validated in more than fifty experiments in research and commercial orchards, six of which are presented and discussed in detail.

[1]  Philippe Martinet,et al.  Visual navigation of a quadrotor Aerial Vehicle , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Francisco Bonin-Font,et al.  Visual Navigation for Mobile Robots: A Survey , 2008, J. Intell. Robotic Syst..

[3]  Dezhen Song,et al.  Vision-based motion planning for an autonomous motorcycle on ill-structured roads , 2007, Auton. Robots.

[4]  Roland Siegwart,et al.  MAV navigation through indoor corridors using optical flow , 2010, 2010 IEEE International Conference on Robotics and Automation.

[5]  Yong-Ren Huang,et al.  Fast Algorithm for Structured and Unstructured Road Detection , 2009, 2009 2nd International Congress on Image and Signal Processing.

[6]  Roland Siegwart,et al.  Real-time monocular visual odometry for on-road vehicles with 1-point RANSAC , 2009, 2009 IEEE International Conference on Robotics and Automation.

[7]  Christopher Rasmussen,et al.  Grouping dominant orientations for ill-structured road following , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[8]  Feng Wen,et al.  Fast vision-based object segmentation for natural landmark detection on Indoor Mobile Robot , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[9]  Davide Scaramuzza,et al.  1-Point-RANSAC Structure from Motion for Vehicle-Mounted Cameras by Exploiting Non-holonomic Constraints , 2011, International Journal of Computer Vision.

[10]  Ashutosh Saxena,et al.  Autonomous indoor helicopter flight using a single onboard camera , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Arnold W. M. Smeulders,et al.  Color-based object recognition , 1997, Pattern Recognit..

[12]  Dezhen Song,et al.  Vision-based Motion Planning for an Autonomous Motorcycle on Ill-Structured Road , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Supun Samarasekera,et al.  Robust visual path following for heterogeneous mobile platforms , 2010, 2010 IEEE International Conference on Robotics and Automation.

[14]  Jana Kosecka,et al.  Visual Navigation for Mobile Devices , 2010, IEEE MultiMedia.

[15]  Ashutosh Saxena,et al.  Autonomous MAV flight in indoor environments using single image perspective cues , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Byung-Ryong Lee,et al.  New lane detection algorithm for autonomous vehicles using computer vision , 2008, 2008 International Conference on Control, Automation and Systems.

[17]  Vincent Leemans,et al.  Application of the hough transform for seed row localisation using machine vision , 2006 .

[18]  G. van Straten,et al.  A vision based row detection system for sugar beet , 2005 .

[19]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[20]  Michel Dhome,et al.  Generic and real-time structure from motion using local bundle adjustment , 2009, Image Vis. Comput..

[21]  James Sean Humbert,et al.  Erratum to: Implementation of wide-field integration of optic flow for autonomous quadrotor navigation , 2009, Auton. Robots.

[22]  Qin Zhang,et al.  A Stereovision-based Crop Row Detection Method for Tractor-automated Guidance , 2005 .

[23]  Benjamin Grocholsky,et al.  Comprehensive Automation for Specialty Crops: Year 1 results and lessons learned , 2010, Intell. Serv. Robotics.

[24]  Ryan M. Eustice,et al.  Pose-graph visual SLAM with geometric model selection for autonomous underwater ship hull inspection , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[26]  Adrien Bartoli,et al.  Efficient Camera Smoothing in Sequential Structure-from-Motion Using Approximate Cross-Validation , 2008, ECCV.

[27]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[28]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[29]  Philippe Martinet,et al.  Indoor navigation of a non-holonomic mobile robot using a visual memory , 2008, Auton. Robots.

[30]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[31]  Ji Zhang,et al.  Error Aware Monocular Visual Odometry using Vertical Line Pairs for Small Robots in Urban Areas , 2010, AAAI.

[32]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[33]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[34]  Jean Ponce,et al.  General Road Detection From a Single Image , 2010, IEEE Transactions on Image Processing.

[35]  Albert-Jan Baerveldt,et al.  A vision based row-following system for agricultural field machinery , 2005 .

[36]  T D Gillespie,et al.  Fundamentals of Vehicle Dynamics , 1992 .

[37]  Jiri Matas,et al.  Colour-based object recognition , 1995 .

[38]  Navid Nourani-Vatani,et al.  Practical visual odometry for car-like vehicles , 2009, 2009 IEEE International Conference on Robotics and Automation.