Fast visual road recognition and horizon detection using multiple artificial neural networks

The development of autonomous vehicles is a highly relevant research topic in mobile robotics. Road recognition using visual information is an important capability for autonomous navigation in urban environments. Over the last three decades, a large number of visual road recognition approaches have been appeared in the literature. This paper proposes a novel visual road detection system based on multiple artificial neural networks that can identify the road based on color and texture. Several features are used as inputs of the artificial neural network such as: average, entropy, energy and variance from different color channels (RGB, HSV, YUV). As a result, our system is able to estimate the classification and the confidence factor of each part of the environment detected by the camera. Experimental tests have been performed in several situations in order to validate the proposed approach.

[1]  Martin Pellkofer,et al.  EMS-Vision: a perceptual system for autonomous vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[2]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[3]  A. López,et al.  Novel Index for Objective Evaluation of Road Detection Algorithms , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[4]  Yoshiki Ninomiya,et al.  A robust lane detection using real-time voting processor , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[5]  Tommy Chang,et al.  Color model-based real-time learning for road following , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[6]  Dean Pomerleau,et al.  Efficient Training of Artificial Neural Networks for Autonomous Navigation , 1991, Neural Computation.

[7]  Massimo Bertozzi,et al.  Vision-based intelligent vehicles: State of the art and perspectives , 2000, Robotics Auton. Syst..

[8]  Alberto Broggi,et al.  Vision-Based Road Detection in Automotive Systems: A Real-Time Expectation-Driven Approach , 1995, J. Artif. Intell. Res..

[9]  Sanjiv Singh,et al.  The 2005 DARPA Grand Challenge , 2007 .

[10]  D. Pomerleau,et al.  MANIAC : A Next Generation Neurally Based Autonomous Road Follower , 1993 .

[11]  Charles E. Thorpe,et al.  UNSCARF-a color vision system for the detection of unstructured roads , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[12]  Hans-Joachim Wünsche,et al.  A hybrid estimation approach for autonomous dirt road following using multiple clothoid segments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[13]  Alberto Broggi,et al.  A morphological model-driven approach to real-time road boundary detection for vision-based automotive systems , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[14]  M. Foedisch,et al.  Adaptive real-time road detection using neural networks , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[15]  Massimo Bertozzi,et al.  ARGO and the MilleMiglia in Automatico Tour , 1999, IEEE Intell. Syst..

[16]  Denis Fernando Wolf,et al.  A Road Following Approach Using Artificial Neural Networks Combinations , 2011, J. Intell. Robotic Syst..

[17]  Todd Jochem,et al.  Rapidly Adapting Machine Vision for Automated Vehicle Steering , 1996, IEEE Expert.

[18]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Martial Hebert,et al.  Vision and navigation for the Carnegie-Mellon Navlab , 1988 .

[20]  Francisco Bonin-Font,et al.  Visual Navigation for Mobile Robots: A Survey , 2008, J. Intell. Robotic Syst..

[21]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[22]  Ernst D. Dickmanns,et al.  Vehicles Capable of Dynamic Vision: A New Breed of Technical Beings? , 1998, Artif. Intell..

[23]  Takeo Kanade,et al.  Vision and Navigation for the Carnegie-Mellon Navlab , 1987 .

[24]  Joan Serrat,et al.  Vision-based road detection via on-line video registration , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[25]  Aya Takeuchi,et al.  Adaptive road detection through continuous environment learning , 2004, 33rd Applied Imagery Pattern Recognition Workshop (AIPR'04).

[26]  Sanjiv Singh,et al.  The 2005 DARPA Grand Challenge: The Great Robot Race , 2007 .

[27]  Terrence J. Sejnowski,et al.  The Computational Brain , 1996, Artif. Intell..