Remote Sensing Scene Classification Using Convolutional Features and Deep Forest Classifier

High-resolution remote sensing scene classification (HR-RSSC) plays an increasingly important role since it aims to enhance the scene semantic understanding. Recently, convolutional neural networks (CNNs) proved their effectiveness in learning powerful feature representations for various visual recognition tasks. However, in the RS domain, the performance of CNN is still limited due to the lack of sufficient labeled data. In this letter, we propose an HR-RSSC method based on CNN transfer learning (TL) for feature extraction (FE) and deep forest (DF) for classification. In fact, we extract deep features from the last convolutional layer in order to avoid the use of the fully connected layers (FCLs) which need many parameters to tune. Moreover, we train a DF model that is based on ensemble learning that can achieve better performances than single classifiers and is easy to train with few parameters. We evaluate the proposed method on two RS image. Compared to full-training, fine-tuning, and state-of-the-art CNN TL methods, the results demonstrate the effectiveness of the DF model for HR-RSSC based on CNN TL in terms of overall accuracy and training time.

[1]  Ji Feng,et al.  Deep forest , 2017, IJCAI.

[2]  Lei Guo,et al.  When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Shutao Li,et al.  Remote Sensing Scene Classification Using Multilayer Stacked Covariance Pooling , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Gui-Song Xia,et al.  Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery , 2015, Remote. Sens..

[5]  Hongxun Yao,et al.  Deep Feature Fusion for VHR Remote Sensing Scene Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Wenjia Wu,et al.  A NOVEL FRAMEWORK FOR REMOTE SENSING IMAGE SCENE CLASSIFICATION , 2018 .

[7]  Cong Lin,et al.  Integrating Multilayer Features of Convolutional Neural Networks for Remote Sensing Scene Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[9]  Shawn D. Newsam,et al.  Learning Low Dimensional Convolutional Neural Networks for High-Resolution Remote Sensing Image Retrieval , 2016, Remote. Sens..

[10]  Lei Guo,et al.  Remote Sensing Image Scene Classification Using Bag of Convolutional Features , 2017, IEEE Geoscience and Remote Sensing Letters.

[11]  Tomaso A. Poggio,et al.  Regularization Theory and Neural Networks Architectures , 1995, Neural Computation.

[12]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[13]  Jefersson Alex dos Santos,et al.  Towards better exploiting convolutional neural networks for remote sensing scene classification , 2016, Pattern Recognit..

[14]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Haiyang Wang,et al.  Dense adaptive cascade forest: a self-adaptive deep ensemble for classification problems , 2018, Soft Computing.

[16]  Qiang Chen,et al.  Network In Network , 2013, ICLR.