Image Classification using Fast Learning Convolutional Neural Networks

In this paper, we propose an image classification method for improving the learning speed of convolutional neural networks (CNN). Although CNN is widely used in multiclass image classification datasets, the learning speed remains slow for large amounts of data. Therefore, we attempted to improve the learning speed by applying an extreme learning machine (ELM). We propose a learning method combining a network of CNN with this ELM. First, we use an orthogonal bipolar vector (OBV) for studying different types of neural networks. After learning a limited epoch used in the CNN, we determine the output of the neural network using the ELM. To evaluate the performance, we compared the learning speed and classification rate of conventional CNN against the proposed method. Experimental results show that the proposed algorithm has a faster learning curve than the existing algorithm.

[1]  Changshui Zhang,et al.  Traffic Sign Recognition With Hinge Loss Trained Convolutional Neural Networks , 2014, IEEE Transactions on Intelligent Transportation Systems.

[2]  Yann LeCun,et al.  Large-scale Learning with SVM and Convolutional for Generic Object Categorization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  M. Szarvas,et al.  Pedestrian detection with convolutional neural networks , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[4]  Hiroshi Kawakami,et al.  Improved MLP Learning via Orthogonal Bipolar Target Vectors , 2005, J. Adv. Comput. Intell. Intell. Informatics.

[5]  Sven Behnke,et al.  Accelerating Large-Scale Convolutional Neural Networks with Parallel Graphics Multiprocessors , 2010, ICANN.

[6]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.