Vision-Based Robust Path Reconstruction for Robot Control

Many applications in mobile robotics require the localization of the robot with respect to the boundary of a path (e.g., a lane marker) and the reconstruction of the path in front of the robot. The former can be used as a basis for a reactive control scheme that drives the robot along the specified path and the latter is used to plan its future motion. Our solution to these problems relies on a camera mounted on the chassis and pointing headway. The relevant elements of the image grabbed from the camera (i.e., the lines delimiting the path) are robustly extracted and projected into the field-of-view of a virtual camera looking over the scene from above. This way, we obtain a top plan view that allows us to reconstruct position and bearing of the vehicle irrespective of mechanical vibrations or imperfect plane of motion. What is more, by pushing forward the virtual camera, we are able to reconstruct the path in front of the robot for some distance ahead. In this paper, we describe the main ideas underlying the approach and its implementation. The accuracy of the technique and the computational workload is evaluated through a large set of experiments.

[1]  Li Bai,et al.  Robust Road Modeling and Tracking Using Condensation , 2008, IEEE Transactions on Intelligent Transportation Systems.

[2]  Monson H. Hayes,et al.  A Template Matching and Ellipse Modeling Approach to Detecting Lane Markers , 2010, ACIVS.

[3]  Tomoharu Nagao,et al.  Onboard Evolutionary Risk Recognition System for Automobiles—Toward the Risk Map System , 2007, IEEE Transactions on Industrial Electronics.

[4]  Hong Qiao,et al.  Multiple ellipses detection in noisy environments: A hierarchical approach , 2009, Pattern Recognit..

[5]  W. Clem Karl,et al.  Line detection in images through regularized hough transform , 2006, IEEE Transactions on Image Processing.

[6]  Felipe Jiménez Improvements in road geometry measurement using inertial measurement systems in datalog vehicles , 2011 .

[7]  Christophe Boucher,et al.  A Hybrid Particle Approach for GNSS Applications With Partial GPS Outages , 2010, IEEE Transactions on Instrumentation and Measurement.

[8]  Luca Mesin,et al.  New System for Detecting Road Ice Formation , 2011, IEEE Transactions on Instrumentation and Measurement.

[9]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[10]  Y.-S. Liu,et al.  Polling an Image for Circles by Random Lines , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[12]  Antonio Guiducci,et al.  Parametric Model of the Perspective Projection of a Road with Applications to Lane Keeping and 3D Road Reconstruction , 1999, Comput. Vis. Image Underst..

[13]  Erkki Oja,et al.  Randomized hough transform (rht) : Basic mech-anisms, algorithms, and computational complexities , 1993 .

[14]  P. Nagabhushan,et al.  A simple and robust line detection algorithm based on small eigenvalue analysis , 2004, Pattern Recognit. Lett..

[15]  Gamini Dissanayake,et al.  Robust lane detection in urban environments , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Din-Chang Tseng,et al.  A Robust Lane Detection and Verification Method for Intelligent Vehicles , 2009, 2009 Third International Symposium on Intelligent Information Technology Application.

[17]  Luc Van Gool,et al.  3D Urban Scene Modeling Integrating Recognition and Reconstruction , 2008, International Journal of Computer Vision.

[18]  G. Vanderbrug,et al.  Line Detection in Satellite Imagery , 1976, IEEE Transactions on Geoscience Electronics.

[19]  Cesare Svelto,et al.  Optical Sensors for Real-Time Measurement of Motorcycle Tilt Angle , 2009, IEEE Transactions on Instrumentation and Measurement.

[20]  Thambipillai Srikanthan,et al.  Hierarchical Additive Hough Transform for Lane Detection , 2010, IEEE Embedded Systems Letters.

[21]  Li Xu,et al.  Estimation of land vehicle roll and pitch angles , 2007 .

[22]  Bo Zhang,et al.  Color-based road detection in urban traffic scenes , 2004, IEEE Transactions on Intelligent Transportation Systems.

[23]  Sanjiv Singh,et al.  The 2005 DARPA Grand Challenge , 2007 .

[24]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[25]  D. Fontanelli,et al.  Vision-based robust localization for vehicles , 2012, 2012 IEEE International Instrumentation and Measurement Technology Conference Proceedings.

[26]  Werner von Seelen,et al.  Image processing and behavior planning for intelligent vehicles , 2003, IEEE Trans. Ind. Electron..

[27]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  D. Macii,et al.  A RANSAC-based fast road line detection algorithm for high-speed wheeled vehicles , 2011, 2011 IEEE International Instrumentation and Measurement Technology Conference.

[29]  Yu Chin Cheng,et al.  The distinctiveness of a curve in a parameterized neighborhood: extraction and applications , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[31]  Yong Chen,et al.  Robust lane detection based on gradient direction , 2011, 2011 6th IEEE Conference on Industrial Electronics and Applications.

[32]  Joan Serrat,et al.  Robust Lane Lines Detection and Quantitative Assessment , 2007, IbPRIA.

[33]  Sergiu Nedevschi,et al.  Probabilistic Lane Tracking in Difficult Road Scenarios Using Stereovision , 2009, IEEE Transactions on Intelligent Transportation Systems.

[34]  Daniele Fontanelli,et al.  A Fast RANSAC-Based Registration Algorithm for Accurate Localization in Unknown Environments using LIDAR Measurements , 2007, 2007 IEEE International Conference on Automation Science and Engineering.

[35]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[36]  Joan Serrat,et al.  Robust lane markings detection and road geometry computation , 2010 .

[37]  Jean-Paul Laumond,et al.  Robot Motion Planning and Control , 1998 .

[38]  Bing-Fei Wu,et al.  Dynamic Calibration and Occlusion Handling Algorithms for Lane Tracking , 2009, IEEE Transactions on Industrial Electronics.

[39]  Naim Dahnoun,et al.  A novel system for robust lane detection and tracking , 2012, Signal Process..

[40]  Mohan M. Trivedi,et al.  Improved vision-based lane tracker performance using vehicle localization , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[41]  Monson H. Hayes,et al.  Robust lane detection and tracking with ransac and Kalman filter , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[42]  João P. Hespanha,et al.  Trajectory-Tracking and Path-Following of Underactuated Autonomous Vehicles With Parametric Modeling Uncertainty , 2007, IEEE Transactions on Automatic Control.

[43]  Leonhard M. Reindl,et al.  The "intelligent tire" utilizing passive SAW sensors measurement of tire friction , 1999, IEEE Trans. Instrum. Meas..

[44]  Wuhong Wang A Digital-Driving System for Smart Vehicles , 2002, IEEE Intell. Syst..

[45]  Romuald Aufrère,et al.  Accurate road following and reconstruction by computer vision , 2002, IEEE Trans. Intell. Transp. Syst..

[46]  Seiichi Mita,et al.  Lane detection and tracking in challenging environments based on a weighted graph and integrated cues , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[47]  Yong Zhou,et al.  A robust lane detection and tracking method based on computer vision , 2006 .

[48]  Antonio Bicchi,et al.  Visual Servoing in the Large , 2009, Int. J. Robotics Res..

[49]  Luigi Palopoli,et al.  High speed robotics with low cost hardware , 2012, Proceedings of 2012 IEEE 17th International Conference on Emerging Technologies & Factory Automation (ETFA 2012).

[50]  Claude Samson,et al.  Feedback control of a nonholonomic wheeled cart in Cartesian space , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[51]  Felipe Espinosa,et al.  Design and implementation of a portable electronic system for vehicle–driver–route activity measurement , 2011 .

[52]  J. Little,et al.  Inverse perspective mapping simplifies optical flow computation and obstacle detection , 2004, Biological Cybernetics.

[53]  F. Chausse,et al.  Accurate vision based road tracker , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[54]  Jo Yung Wong,et al.  Theory of ground vehicles , 1978 .