Combining CNN and MRF for Road Detection

Road detection aims at detecting the (drivable) road surface ahead vehicle and plays a crucial role in driver assistance system. To improve the accuracy and robustness of road detection approaches in complex environments, a new road detection method based on CNN (convolutional neural network) and MRF (markov random field) is proposed. The original road image is segmented into super-pixels of uniform size using simple linear iterative clustering (SLIC) algorithm. On this basis, we train the CNN which can automatically learn the features that are most beneficial to classification. Then, the trained CNN is applied to classify road region and non-road region. Finally, based on the relationship between the super-pixels neighborhood, we utilize MRF to optimize the classification results of CNN. Quantitative and qualitative experiments on the publicly datasets demonstrate that the proposed method is robust in complex environments. Furthermore, compared with state-of-the-art algorithms, the approach provides the better performance.

[1]  Huimin Lu,et al.  FDCNet: filtering deep convolutional network for marine organism classification , 2018, Multimedia Tools and Applications.

[2]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[3]  Antonio M. López,et al.  Road Detection Based on Illuminant Invariance , 2011, IEEE Transactions on Intelligent Transportation Systems.

[4]  Chao Zhang,et al.  Lane boundary detection based on parabola model , 2010, The 2010 IEEE International Conference on Information and Automation.

[5]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  David Fernández Llorca,et al.  A Comparative Analysis of Decision Trees Based Classifiers for Road Detection in Urban Environments , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[7]  Xuelong Li,et al.  Visual Attention Accelerated Vehicle Detection in Low-Altitude Airborne Video of Urban Environment , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Huimin Lu,et al.  Underwater image dehazing using joint trilateral filter , 2014, Comput. Electr. Eng..

[9]  Bin Li,et al.  Wound intensity correction and segmentation with convolutional neural networks , 2017, Concurr. Comput. Pract. Exp..

[10]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Huimin Lu,et al.  Brain Intelligence: Go beyond Artificial Intelligence , 2017, Mobile Networks and Applications.

[12]  Roberto Cipolla,et al.  Semantic object classes in video: A high-definition ground truth database , 2009, Pattern Recognit. Lett..

[13]  C. V. Jawahar,et al.  Scene Text Recognition using Higher Order Language Priors , 2009, BMVC.

[14]  Ke Wang Algorithm for Urban Road Detection Based on Uncertain Bezier Deformable Template , 2013 .

[15]  Qi Wang,et al.  Video-based road detection via online structural learning , 2015, Neurocomputing.

[16]  Vincent Frémont,et al.  Exploiting fully convolutional neural networks for fast road detection , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Roberto Cipolla,et al.  Segmentation and Recognition Using Structure from Motion Point Clouds , 2008, ECCV.

[18]  Jean Ponce,et al.  Vanishing point detection for road detection , 2009, CVPR.

[19]  Igi Ardiyanto,et al.  Deep residual coalesced convolutional network for efficient semantic road segmentation , 2017, IPSJ Transactions on Computer Vision and Applications.

[20]  Huimin Lu,et al.  Underwater image de-scattering and classification by deep neural network , 2016, Comput. Electr. Eng..

[21]  Huimin Lu,et al.  Motor Anomaly Detection for Unmanned Aerial Vehicles Using Reinforcement Learning , 2018, IEEE Internet of Things Journal.

[22]  Yann LeCun,et al.  Road Scene Segmentation from a Single Image , 2012, ECCV.

[23]  Joseph F. Murray,et al.  Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation , 2010, Neural Computation.

[24]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.