PTL-CFS based deep convolutional neural network model for remote sensing classification

Processing high-dimensional remote sensing images data with conventional convolutional neural networks raises certain issues such as prolonged model convergence time, vanishing gradient, convergence of the non-minimum values, etc. due to its high time-complexity and random initialization parameters nature. Aiming at those issues, this article proposes a convolutional neural network remote sensing classification model based on PTL-CFS. This model approach first utilizes parameter transfer learning algorithm to obtain the CNN initialization parameters of the target area, then it uses correlation-based feature selection algorithm to eliminate the redundant features and noises from the original feature set, finally, it classifies the remote sensing images using a conventional CNN model. This article has proven the validity of such network model when classifying remote sensing images in the Zha long wetland, Heilongjiang. Experiments show that the addition of PTL can accelerate the loss function of the convergence rate in CNN. The algorithm combined with CFS algorithm, compared with other algorithms to reduce the algorithm execution time and get better classification accuracy.

[1]  Anders Krogh,et al.  Hidden Neural Networks , 1999, Neural Computation.

[2]  Xiaogang Wang,et al.  Joint Deep Learning for Pedestrian Detection , 2013, 2013 IEEE International Conference on Computer Vision.

[3]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[4]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[5]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[6]  William J. Emery,et al.  A neural network approach using multi-scale textural metrics from very high-resolution panchromatic imagery for urban land-use classification , 2009 .

[7]  Yifan Gong,et al.  An analysis of convolutional neural networks for speech recognition , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[9]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[11]  Yann LeCun,et al.  Large-scale Learning with SVM and Convolutional for Generic Object Categorization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  S. Billings,et al.  Feature Subset Selection and Ranking for Data Dimensionality Reduction , 2007 .

[13]  Gerald Penn,et al.  Convolutional Neural Networks for Speech Recognition , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[14]  George Saon,et al.  Analyzing convolutional neural networks for speech activity detection in mismatched acoustic conditions , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Claus Nebauer,et al.  Evaluation of convolutional neural networks for visual recognition , 1998, IEEE Trans. Neural Networks.

[16]  Zhang Yu-hong Wetland Remote Sensing Classification Using Support Vector Machine Optimized With Genetic Algorithm: A Case Study in Honghe Nature National Reserve , 2012 .

[17]  Massimiliano Pontil,et al.  Regularized multi--task learning , 2004, KDD.

[18]  Jonathan Li,et al.  Bayesian Classification of Hyperspectral Imagery Based on Probabilistic Sparse Representation and Markov Random Field , 2014, IEEE Geoscience and Remote Sensing Letters.

[19]  Qiang Yang,et al.  Heterogeneous Transfer Learning for Image Classification , 2011, AAAI.

[20]  Qiang Yang,et al.  Translated Learning: Transfer Learning across Different Feature Spaces , 2008, NIPS.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[23]  Gerald Penn,et al.  Applying Convolutional Neural Networks concepts to hybrid NN-HMM model for speech recognition , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Jia Lei,et al.  Deep Learning: Yesterday, Today, and Tomorrow , 2013 .

[25]  Yue Qi,et al.  A deep convolution neural network for object detection based , 2017 .

[26]  Xiaodong Yu,et al.  Wetland remote sensing classification using support vector machine optimized with co-evolutionary algorithm , 2017, 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS).