Fast learning method for convolutional neural networks using extreme learning machine and its application to lane detection

Deep learning has received significant attention recently as a promising solution to many problems in the area of artificial intelligence. Among several deep learning architectures, convolutional neural networks (CNNs) demonstrate superior performance when compared to other machine learning methods in the applications of object detection and recognition. We use a CNN for image enhancement and the detection of driving lanes on motorways. In general, the process of lane detection consists of edge extraction and line detection. A CNN can be used to enhance the input images before lane detection by excluding noise and obstacles that are irrelevant to the edge detection result. However, training conventional CNNs requires considerable computation and a big dataset. Therefore, we suggest a new learning algorithm for CNNs using an extreme learning machine (ELM). The ELM is a fast learning method used to calculate network weights between output and hidden layers in a single iteration and thus, can dramatically reduce learning time while producing accurate results with minimal training data. A conventional ELM can be applied to networks with a single hidden layer; as such, we propose a stacked ELM architecture in the CNN framework. Further, we modify the backpropagation algorithm to find the targets of hidden layers and effectively learn network weights while maintaining performance. Experimental results confirm that the proposed method is effective in reducing learning time and improving performance.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Minho Lee,et al.  Robust Lane Detection Based On Convolutional Neural Network and Random Sample Consensus , 2014, ICONIP.

[3]  Kwanghoon Sohn,et al.  Real-time illumination invariant lane detection for lane departure warning system , 2015, Expert Syst. Appl..

[4]  Yann LeCun,et al.  Traffic sign recognition with multi-scale Convolutional Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[5]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[6]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[7]  S. Khan,et al.  Real time lane detection for autonomous vehicles , 2008, 2008 International Conference on Computer and Communication Engineering.

[8]  Massimo Bertozzi,et al.  Real-time lane and obstacle detection on the GOLD system , 1996, Proceedings of Conference on Intelligent Vehicles.

[9]  Mark D. McDonnell,et al.  Deep extreme learning machines: supervised autoencoding architecture for classification , 2016, Neurocomputing.

[10]  Qinghua Wen,et al.  Road Boundary Detection in Complex Urban Environment based on Low-Resolution Vision , 2008 .

[11]  D TisseraMigel,et al.  Deep extreme learning machines , 2016 .

[12]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[13]  Dong-Chul Park,et al.  Image Classification using Fast Learning Convolutional Neural Networks , 2015 .

[14]  Emilio Frazzoli,et al.  Multivehicle Cooperative Driving Using Cooperative Perception: Design and Experimental Validation , 2015, IEEE Transactions on Intelligent Transportation Systems.

[15]  H. Robbins A Stochastic Approximation Method , 1951 .

[16]  Cuneyt Akinlar,et al.  Video-Based Lane Detection Using a Fast Vanishing Point Estimation Method , 2012, 2012 IEEE International Symposium on Multimedia.

[17]  D. Shanno Conditioning of Quasi-Newton Methods for Function Minimization , 1970 .

[18]  Monson H. Hayes,et al.  A Novel Lane Detection System With Efficient Ground Truth Generation , 2012, IEEE Transactions on Intelligent Transportation Systems.

[19]  Junqiang Xi,et al.  A novel lane detection based on geometrical model and Gabor filter , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[20]  Xinming Huang,et al.  Road marking detection and classification using machine learning algorithms , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[21]  Bruno Emile,et al.  Road Markings Detection and Tracking Using Hough Transform and Kalman Filter , 2005, ACIVS.

[22]  Miguel Torres-Torriti,et al.  Robust Lane Sensing and Departure Warning under Shadows and Occlusions , 2013, Sensors.

[23]  Kabir Ahmed,et al.  Road Boundary Detection by a Remote Vehicle Using Radon Transform for Path Map Generation of an Unknown Area , 2008 .

[24]  Se-Young Oh,et al.  Fast training of convolutional neural network classifiers through extreme learning machines , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[25]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[26]  Joachim Denzler,et al.  Convolutional Patch Networks with Spatial Prior for Road Detection and Urban Scene Understanding , 2015, VISAPP.

[27]  Gyu-In Jee,et al.  Curve modeled lane and stop line detection based GPS error estimation filter , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[28]  Zhenghao Chen,et al.  On Random Weights and Unsupervised Feature Learning , 2011, ICML.

[29]  Alexander Zelinsky,et al.  Robust vision based lane tracking using multiple cues and particle filtering , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[30]  Yujun Zeng,et al.  Traffic Sign Recognition Using Extreme Learning Classifier with Deep Convolutional Features , 2015 .

[31]  C. Kreucher,et al.  A DRIVER WARNING SYSTEM BASED ON THE LOIS LANE DETECTION ALGORITHM , 1998 .

[32]  Wei Huang,et al.  A Lane Detection Method for Lane Departure Warning System , 2010, 2010 International Conference on Optoelectronics and Image Processing.

[33]  Shigang Wang,et al.  Lane detection and tracking using a new lane model and distance transform , 2011, Mach. Vis. Appl..

[34]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[35]  Albert Ali Salah,et al.  Kernel ELM and CNN Based Facial Age Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[36]  Wei Zeng,et al.  CNN Based Vehicle Counting with Virtual Coil in Traffic Surveillance Video , 2015, 2015 IEEE International Conference on Multimedia Big Data.

[37]  Huaping Liu,et al.  Multi-modal Deep Extreme Learning Machine for Robotic Grasping Recognition , 2016 .

[38]  M. Bertozzi,et al.  Real-Time Lane and Obstacle Detection on the System ∗ , 1996 .

[39]  Jianwei Niu,et al.  Robust Lane Detection using Two-stage Feature Extraction with Curve Fitting , 2016, Pattern Recognit..

[40]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[41]  In-So Kweon,et al.  Combinatorial approach for lane detection using image and LIDAR reflectance , 2015, 2015 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[42]  Shifei Ding,et al.  A hybrid deep learning CNN-ELM model and its application in handwritten numeral recognition , 2015 .

[43]  Martin Fodslette Meiller A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning , 1993 .

[44]  Gamini Dissanayake,et al.  Efficient Lane Detection and Tracking in Urban Environments , 2007, EMCR.

[45]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).